Running Suite: Kubernetes e2e suite - /usr/local/bin ==================================================== Random Seed: 1758504619 - will randomize all specs Will run 232 of 7132 specs Running in parallel across 10 processes SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•S•••SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSS•SSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS••SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSS•SSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSS•SSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSS•SSSSSSSSSSSS•SSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSS•SSSSSSSSSSSSS•••SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SS•SSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSS•SSSSSSS•SSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSS•SSSSSSSSSSSSSSSS••SSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSS•SSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS••SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSS•SSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [FAILED] [306.741 seconds] [sig-storage] MutableCSINodeAllocatableCount [FeatureGate:MutableCSINodeAllocatableCount] [Beta] [Feature:OffByDefault] Attach Limit Exceeded [It] should transition pod to failed state when attachment limit exceeded [sig-storage, FeatureGate:MutableCSINodeAllocatableCount, Beta, Feature:OffByDefault, BetaOffByDefault] k8s.io/kubernetes/test/e2e/storage/csimock/mutable_csinode_allocatable.go:175 Timeline >> STEP: Creating a kubernetes client @ 09/22/25 01:31:25.35 I0922 01:31:25.350765 17 util.go:454] >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename mutable-allocatable-mock @ 09/22/25 01:31:25.352 STEP: Waiting for a default service account to be provisioned in namespace @ 09/22/25 01:31:25.361 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace @ 09/22/25 01:31:25.366 STEP: Building a driver namespace object, basename mutable-allocatable-mock-8613 @ 09/22/25 01:31:25.371 STEP: Waiting for a default service account to be provisioned in namespace @ 09/22/25 01:31:25.379 STEP: deploying csi mock proxy @ 09/22/25 01:31:25.384 I0922 01:31:25.452715 17 create.go:156] creating *v1.ServiceAccount: mutable-allocatable-mock-8613-4748/csi-attacher I0922 01:31:25.457625 17 create.go:156] creating *v1.ClusterRole: external-attacher-runner-mutable-allocatable-mock-8613 I0922 01:31:25.457644 17 create.go:425] Define cluster role external-attacher-runner-mutable-allocatable-mock-8613 I0922 01:31:25.462167 17 create.go:156] creating *v1.ClusterRoleBinding: csi-attacher-role-mutable-allocatable-mock-8613 I0922 01:31:25.466556 17 create.go:156] creating *v1.Role: mutable-allocatable-mock-8613-4748/external-attacher-cfg-mutable-allocatable-mock-8613 I0922 01:31:25.470793 17 create.go:156] creating *v1.RoleBinding: mutable-allocatable-mock-8613-4748/csi-attacher-role-cfg I0922 01:31:25.475216 17 create.go:156] creating *v1.ServiceAccount: mutable-allocatable-mock-8613-4748/csi-provisioner I0922 01:31:25.479211 17 create.go:156] creating *v1.ClusterRole: external-provisioner-runner-mutable-allocatable-mock-8613 I0922 01:31:25.479229 17 create.go:425] Define cluster role external-provisioner-runner-mutable-allocatable-mock-8613 I0922 01:31:25.484112 17 create.go:156] creating *v1.ClusterRoleBinding: csi-provisioner-role-mutable-allocatable-mock-8613 I0922 01:31:25.488258 17 create.go:156] creating *v1.Role: mutable-allocatable-mock-8613-4748/external-provisioner-cfg-mutable-allocatable-mock-8613 I0922 01:31:25.492600 17 create.go:156] creating *v1.RoleBinding: mutable-allocatable-mock-8613-4748/csi-provisioner-role-cfg I0922 01:31:25.496622 17 create.go:156] creating *v1.ServiceAccount: mutable-allocatable-mock-8613-4748/csi-resizer I0922 01:31:25.500386 17 create.go:156] creating *v1.ClusterRole: external-resizer-runner-mutable-allocatable-mock-8613 I0922 01:31:25.500406 17 create.go:425] Define cluster role external-resizer-runner-mutable-allocatable-mock-8613 I0922 01:31:25.504433 17 create.go:156] creating *v1.ClusterRoleBinding: csi-resizer-role-mutable-allocatable-mock-8613 I0922 01:31:25.508911 17 create.go:156] creating *v1.Role: mutable-allocatable-mock-8613-4748/external-resizer-cfg-mutable-allocatable-mock-8613 I0922 01:31:25.512995 17 create.go:156] creating *v1.RoleBinding: mutable-allocatable-mock-8613-4748/csi-resizer-role-cfg I0922 01:31:25.517849 17 create.go:156] creating *v1.ServiceAccount: mutable-allocatable-mock-8613-4748/csi-snapshotter I0922 01:31:25.523795 17 create.go:156] creating *v1.ClusterRole: external-snapshotter-runner-mutable-allocatable-mock-8613 I0922 01:31:25.524744 17 create.go:425] Define cluster role external-snapshotter-runner-mutable-allocatable-mock-8613 I0922 01:31:25.528915 17 create.go:156] creating *v1.ClusterRoleBinding: csi-snapshotter-role-mutable-allocatable-mock-8613 I0922 01:31:25.533593 17 create.go:156] creating *v1.Role: mutable-allocatable-mock-8613-4748/external-snapshotter-leaderelection-mutable-allocatable-mock-8613 I0922 01:31:25.537869 17 create.go:156] creating *v1.RoleBinding: mutable-allocatable-mock-8613-4748/external-snapshotter-leaderelection I0922 01:31:25.542121 17 create.go:156] creating *v1.ServiceAccount: mutable-allocatable-mock-8613-4748/csi-mock I0922 01:31:25.546073 17 create.go:156] creating *v1.ClusterRoleBinding: csi-controller-attacher-role-mutable-allocatable-mock-8613 I0922 01:31:25.549976 17 create.go:156] creating *v1.ClusterRoleBinding: csi-controller-provisioner-role-mutable-allocatable-mock-8613 I0922 01:31:25.554020 17 create.go:156] creating *v1.ClusterRoleBinding: csi-controller-cluster-driver-registrar-role-mutable-allocatable-mock-8613 I0922 01:31:25.558450 17 create.go:156] creating *v1.ClusterRoleBinding: psp-csi-controller-driver-registrar-role-mutable-allocatable-mock-8613 I0922 01:31:25.562422 17 create.go:156] creating *v1.ClusterRoleBinding: csi-controller-resizer-role-mutable-allocatable-mock-8613 I0922 01:31:25.566461 17 create.go:156] creating *v1.ClusterRoleBinding: csi-controller-snapshotter-role-mutable-allocatable-mock-8613 I0922 01:31:25.570680 17 create.go:156] creating *v1.StorageClass: csi-mock-sc-mutable-allocatable-mock-8613 I0922 01:31:25.574981 17 create.go:156] creating *v1.StatefulSet: mutable-allocatable-mock-8613-4748/csi-mockplugin I0922 01:31:25.582055 17 create.go:156] creating *v1.CSIDriver: csi-mock-mutable-allocatable-mock-8613 I0922 01:31:25.586482 17 create.go:156] creating *v1.StatefulSet: mutable-allocatable-mock-8613-4748/csi-mockplugin-attacher I0922 01:31:25.599028 17 csi.go:1010] waiting for CSIDriver csi-mock-mutable-allocatable-mock-8613 to register on node latest-worker2 I0922 01:31:29.173906 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Identity/GetPluginInfo","Request":{},"Response":{"name":"csi-mock-mutable-allocatable-mock-8613","vendor_version":"0.3.0","manifest":{"url":"https://github.com/kubernetes/kubernetes/tree/master/test/e2e/storage/drivers/csi-test/mock"}},"Error":"","FullError":null} I0922 01:31:29.360379 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Node/NodeGetInfo","Request":{},"Response":{"node_id":"csi-mock-mutable-allocatable-mock-8613"},"Error":"","FullError":null} I0922 01:31:30.067397 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Identity/Probe","Request":{},"Response":{"ready":{"value":true}},"Error":"","FullError":null} I0922 01:31:30.069359 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Identity/GetPluginInfo","Request":{},"Response":{"name":"csi-mock-mutable-allocatable-mock-8613","vendor_version":"0.3.0","manifest":{"url":"https://github.com/kubernetes/kubernetes/tree/master/test/e2e/storage/drivers/csi-test/mock"}},"Error":"","FullError":null} I0922 01:31:30.071145 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Identity/GetPluginCapabilities","Request":{},"Response":{"capabilities":[{"Type":{"Service":{"type":1}}},{"Type":{"VolumeExpansion":{"type":1}}}]},"Error":"","FullError":null} I0922 01:31:30.072878 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Controller/ControllerGetCapabilities","Request":{},"Response":{"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":4}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":8}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":12}}},{"Type":{"Rpc":{"type":11}}},{"Type":{"Rpc":{"type":14}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":9}}}]},"Error":"","FullError":null} STEP: Creating pod @ 09/22/25 01:31:30.61 I0922 01:31:30.614352 17 pv.go:646] Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil I0922 01:31:30.621647 17 pv.go:790] Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-4gpbr] to have phase Bound I0922 01:31:30.624655 17 pv.go:806] PersistentVolumeClaim pvc-4gpbr found but phase is Pending instead of Bound. I0922 01:31:30.631134 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Controller/CreateVolume","Request":{"name":"pvc-2fee841a-7c7e-40ab-8b84-13ada77e3420","capacity_range":{"required_bytes":1073741824},"volume_capabilities":[{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}}]},"Response":{"volume":{"capacity_bytes":1073741824,"volume_id":"4","volume_context":{"name":"pvc-2fee841a-7c7e-40ab-8b84-13ada77e3420"}}},"Error":"","FullError":null} I0922 01:31:31.272222 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Identity/Probe","Request":{},"Response":{"ready":{"value":true}},"Error":"","FullError":null} I0922 01:31:31.274296 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Identity/GetPluginInfo","Request":{},"Response":{"name":"csi-mock-mutable-allocatable-mock-8613","vendor_version":"0.3.0","manifest":{"url":"https://github.com/kubernetes/kubernetes/tree/master/test/e2e/storage/drivers/csi-test/mock"}},"Error":"","FullError":null} I0922 01:31:31.276690 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Identity/GetPluginCapabilities","Request":{},"Response":{"capabilities":[{"Type":{"Service":{"type":1}}},{"Type":{"VolumeExpansion":{"type":1}}}]},"Error":"","FullError":null} I0922 01:31:31.278486 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Controller/ControllerGetCapabilities","Request":{},"Response":{"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":4}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":8}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":12}}},{"Type":{"Rpc":{"type":11}}},{"Type":{"Rpc":{"type":14}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":9}}}]},"Error":"","FullError":null} I0922 01:31:31.381901 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Controller/ListVolumes","Request":{},"Response":{"entries":[{"volume":{"capacity_bytes":107374182400,"volume_id":"1","volume_context":{"name":"Mock Volume 1"}},"status":{"published_node_ids":["csi-mock-mutable-allocatable-mock-8613"],"volume_condition":{}}},{"volume":{"capacity_bytes":107374182400,"volume_id":"2","volume_context":{"name":"Mock Volume 2"}},"status":{"published_node_ids":["csi-mock-mutable-allocatable-mock-8613"],"volume_condition":{}}},{"volume":{"capacity_bytes":107374182400,"volume_id":"3","volume_context":{"name":"Mock Volume 3"}},"status":{"published_node_ids":["csi-mock-mutable-allocatable-mock-8613"],"volume_condition":{}}},{"volume":{"capacity_bytes":1073741824,"volume_id":"4","volume_context":{"name":"pvc-2fee841a-7c7e-40ab-8b84-13ada77e3420"}},"status":{"published_node_ids":["csi-mock-mutable-allocatable-mock-8613"],"volume_condition":{}}}]},"Error":"","FullError":null} I0922 01:31:32.629557 17 pv.go:801] PersistentVolumeClaim pvc-4gpbr found and phase=Bound (2.00784737s) STEP: Checking if VolumeAttachment was created for the pod @ 09/22/25 01:31:32.642 I0922 01:31:32.688095 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Controller/ControllerPublishVolume","Request":{"volume_id":"4","node_id":"csi-mock-mutable-allocatable-mock-8613","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"name":"pvc-2fee841a-7c7e-40ab-8b84-13ada77e3420","storage.kubernetes.io/csiProvisionerIdentity":"1758504690074-7658-csi-mock-mutable-allocatable-mock-8613"}},"Response":null,"Error":"rpc error: code = ResourceExhausted desc = attachment limit exceeded","FullError":{"code":8,"message":"attachment limit exceeded"}} I0922 01:31:32.700343 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Controller/ControllerPublishVolume","Request":{"volume_id":"4","node_id":"csi-mock-mutable-allocatable-mock-8613","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"name":"pvc-2fee841a-7c7e-40ab-8b84-13ada77e3420","storage.kubernetes.io/csiProvisionerIdentity":"1758504690074-7658-csi-mock-mutable-allocatable-mock-8613"}},"Response":null,"Error":"rpc error: code = ResourceExhausted desc = attachment limit exceeded","FullError":{"code":8,"message":"attachment limit exceeded"}} I0922 01:31:33.701692 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Controller/ControllerPublishVolume","Request":{"volume_id":"4","node_id":"csi-mock-mutable-allocatable-mock-8613","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"name":"pvc-2fee841a-7c7e-40ab-8b84-13ada77e3420","storage.kubernetes.io/csiProvisionerIdentity":"1758504690074-7658-csi-mock-mutable-allocatable-mock-8613"}},"Response":null,"Error":"rpc error: code = ResourceExhausted desc = attachment limit exceeded","FullError":{"code":8,"message":"attachment limit exceeded"}} STEP: Waiting for Pod to fail with VolumeAttachmentLimitExceeded @ 09/22/25 01:31:34.66 I0922 01:31:37.712184 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Controller/ControllerPublishVolume","Request":{"volume_id":"4","node_id":"csi-mock-mutable-allocatable-mock-8613","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"name":"pvc-2fee841a-7c7e-40ab-8b84-13ada77e3420","storage.kubernetes.io/csiProvisionerIdentity":"1758504690074-7658-csi-mock-mutable-allocatable-mock-8613"}},"Response":null,"Error":"rpc error: code = ResourceExhausted desc = attachment limit exceeded","FullError":{"code":8,"message":"attachment limit exceeded"}} I0922 01:31:45.726297 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Controller/ControllerPublishVolume","Request":{"volume_id":"4","node_id":"csi-mock-mutable-allocatable-mock-8613","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"name":"pvc-2fee841a-7c7e-40ab-8b84-13ada77e3420","storage.kubernetes.io/csiProvisionerIdentity":"1758504690074-7658-csi-mock-mutable-allocatable-mock-8613"}},"Response":null,"Error":"rpc error: code = ResourceExhausted desc = attachment limit exceeded","FullError":{"code":8,"message":"attachment limit exceeded"}} I0922 01:32:01.739982 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Controller/ControllerPublishVolume","Request":{"volume_id":"4","node_id":"csi-mock-mutable-allocatable-mock-8613","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"name":"pvc-2fee841a-7c7e-40ab-8b84-13ada77e3420","storage.kubernetes.io/csiProvisionerIdentity":"1758504690074-7658-csi-mock-mutable-allocatable-mock-8613"}},"Response":null,"Error":"rpc error: code = ResourceExhausted desc = attachment limit exceeded","FullError":{"code":8,"message":"attachment limit exceeded"}} I0922 01:32:31.387352 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Controller/ListVolumes","Request":{},"Response":{"entries":[{"volume":{"capacity_bytes":107374182400,"volume_id":"1","volume_context":{"name":"Mock Volume 1"}},"status":{"published_node_ids":["csi-mock-mutable-allocatable-mock-8613"],"volume_condition":{}}},{"volume":{"capacity_bytes":107374182400,"volume_id":"2","volume_context":{"name":"Mock Volume 2"}},"status":{"published_node_ids":["csi-mock-mutable-allocatable-mock-8613"],"volume_condition":{}}},{"volume":{"capacity_bytes":107374182400,"volume_id":"3","volume_context":{"name":"Mock Volume 3"}},"status":{"published_node_ids":["csi-mock-mutable-allocatable-mock-8613"],"volume_condition":{}}},{"volume":{"capacity_bytes":1073741824,"volume_id":"4","volume_context":{"csi-mock-mutable-allocatable-mock-8613/dev":"/dev/mock","name":"pvc-2fee841a-7c7e-40ab-8b84-13ada77e3420","readonly":"false"}},"status":{"published_node_ids":["csi-mock-mutable-allocatable-mock-8613"],"volume_condition":{}}}]},"Error":"","FullError":null} I0922 01:32:31.391419 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Controller/ControllerPublishVolume","Request":{"volume_id":"4","node_id":"csi-mock-mutable-allocatable-mock-8613","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"name":"pvc-2fee841a-7c7e-40ab-8b84-13ada77e3420","storage.kubernetes.io/csiProvisionerIdentity":"1758504690074-7658-csi-mock-mutable-allocatable-mock-8613"}},"Response":null,"Error":"rpc error: code = ResourceExhausted desc = attachment limit exceeded","FullError":{"code":8,"message":"attachment limit exceeded"}} I0922 01:32:33.750829 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Controller/ControllerPublishVolume","Request":{"volume_id":"4","node_id":"csi-mock-mutable-allocatable-mock-8613","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"name":"pvc-2fee841a-7c7e-40ab-8b84-13ada77e3420","storage.kubernetes.io/csiProvisionerIdentity":"1758504690074-7658-csi-mock-mutable-allocatable-mock-8613"}},"Response":null,"Error":"rpc error: code = ResourceExhausted desc = attachment limit exceeded","FullError":{"code":8,"message":"attachment limit exceeded"}} I0922 01:33:31.391691 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Controller/ListVolumes","Request":{},"Response":{"entries":[{"volume":{"capacity_bytes":107374182400,"volume_id":"1","volume_context":{"name":"Mock Volume 1"}},"status":{"published_node_ids":["csi-mock-mutable-allocatable-mock-8613"],"volume_condition":{}}},{"volume":{"capacity_bytes":107374182400,"volume_id":"2","volume_context":{"name":"Mock Volume 2"}},"status":{"published_node_ids":["csi-mock-mutable-allocatable-mock-8613"],"volume_condition":{}}},{"volume":{"capacity_bytes":107374182400,"volume_id":"3","volume_context":{"name":"Mock Volume 3"}},"status":{"published_node_ids":["csi-mock-mutable-allocatable-mock-8613"],"volume_condition":{}}},{"volume":{"capacity_bytes":1073741824,"volume_id":"4","volume_context":{"csi-mock-mutable-allocatable-mock-8613/dev":"/dev/mock","name":"pvc-2fee841a-7c7e-40ab-8b84-13ada77e3420","readonly":"false"}},"status":{"published_node_ids":["csi-mock-mutable-allocatable-mock-8613"],"volume_condition":{}}}]},"Error":"","FullError":null} I0922 01:33:31.396070 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Controller/ControllerPublishVolume","Request":{"volume_id":"4","node_id":"csi-mock-mutable-allocatable-mock-8613","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"name":"pvc-2fee841a-7c7e-40ab-8b84-13ada77e3420","storage.kubernetes.io/csiProvisionerIdentity":"1758504690074-7658-csi-mock-mutable-allocatable-mock-8613"}},"Response":null,"Error":"rpc error: code = ResourceExhausted desc = attachment limit exceeded","FullError":{"code":8,"message":"attachment limit exceeded"}} I0922 01:34:31.396681 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Controller/ListVolumes","Request":{},"Response":{"entries":[{"volume":{"capacity_bytes":107374182400,"volume_id":"1","volume_context":{"name":"Mock Volume 1"}},"status":{"published_node_ids":["csi-mock-mutable-allocatable-mock-8613"],"volume_condition":{}}},{"volume":{"capacity_bytes":107374182400,"volume_id":"2","volume_context":{"name":"Mock Volume 2"}},"status":{"published_node_ids":["csi-mock-mutable-allocatable-mock-8613"],"volume_condition":{}}},{"volume":{"capacity_bytes":107374182400,"volume_id":"3","volume_context":{"name":"Mock Volume 3"}},"status":{"published_node_ids":["csi-mock-mutable-allocatable-mock-8613"],"volume_condition":{}}},{"volume":{"capacity_bytes":1073741824,"volume_id":"4","volume_context":{"csi-mock-mutable-allocatable-mock-8613/dev":"/dev/mock","name":"pvc-2fee841a-7c7e-40ab-8b84-13ada77e3420","readonly":"false"}},"status":{"published_node_ids":["csi-mock-mutable-allocatable-mock-8613"],"volume_condition":{}}}]},"Error":"","FullError":null} I0922 01:34:31.400662 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Controller/ControllerPublishVolume","Request":{"volume_id":"4","node_id":"csi-mock-mutable-allocatable-mock-8613","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"name":"pvc-2fee841a-7c7e-40ab-8b84-13ada77e3420","storage.kubernetes.io/csiProvisionerIdentity":"1758504690074-7658-csi-mock-mutable-allocatable-mock-8613"}},"Response":null,"Error":"rpc error: code = ResourceExhausted desc = attachment limit exceeded","FullError":{"code":8,"message":"attachment limit exceeded"}} I0922 01:34:41.760374 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Controller/ControllerPublishVolume","Request":{"volume_id":"4","node_id":"csi-mock-mutable-allocatable-mock-8613","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"name":"pvc-2fee841a-7c7e-40ab-8b84-13ada77e3420","storage.kubernetes.io/csiProvisionerIdentity":"1758504690074-7658-csi-mock-mutable-allocatable-mock-8613"}},"Response":null,"Error":"rpc error: code = ResourceExhausted desc = attachment limit exceeded","FullError":{"code":8,"message":"attachment limit exceeded"}} I0922 01:35:31.400798 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Controller/ListVolumes","Request":{},"Response":{"entries":[{"volume":{"capacity_bytes":107374182400,"volume_id":"1","volume_context":{"name":"Mock Volume 1"}},"status":{"published_node_ids":["csi-mock-mutable-allocatable-mock-8613"],"volume_condition":{}}},{"volume":{"capacity_bytes":107374182400,"volume_id":"2","volume_context":{"name":"Mock Volume 2"}},"status":{"published_node_ids":["csi-mock-mutable-allocatable-mock-8613"],"volume_condition":{}}},{"volume":{"capacity_bytes":107374182400,"volume_id":"3","volume_context":{"name":"Mock Volume 3"}},"status":{"published_node_ids":["csi-mock-mutable-allocatable-mock-8613"],"volume_condition":{}}},{"volume":{"capacity_bytes":1073741824,"volume_id":"4","volume_context":{"csi-mock-mutable-allocatable-mock-8613/dev":"/dev/mock","name":"pvc-2fee841a-7c7e-40ab-8b84-13ada77e3420","readonly":"false"}},"status":{"published_node_ids":["csi-mock-mutable-allocatable-mock-8613"],"volume_condition":{}}}]},"Error":"","FullError":null} I0922 01:35:31.404957 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Controller/ControllerPublishVolume","Request":{"volume_id":"4","node_id":"csi-mock-mutable-allocatable-mock-8613","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"name":"pvc-2fee841a-7c7e-40ab-8b84-13ada77e3420","storage.kubernetes.io/csiProvisionerIdentity":"1758504690074-7658-csi-mock-mutable-allocatable-mock-8613"}},"Response":null,"Error":"rpc error: code = ResourceExhausted desc = attachment limit exceeded","FullError":{"code":8,"message":"attachment limit exceeded"}} I0922 01:35:34.667387 17 mutable_csinode_allocatable.go:215] Failed inside E2E framework: k8s.io/kubernetes/test/e2e/framework/pod.WaitForPodCondition({0x7fae352fa698, 0xc0022f39b0}, {0x5aa1d18?, 0xc001982e00?}, {0xc003d9bea0, 0x1d}, {0xc003c3b008, 0x17}, {0xc00105a510, 0x30}, ...) k8s.io/kubernetes/test/e2e/framework/pod/wait.go:315 +0x5b2 k8s.io/kubernetes/test/e2e/framework/pod.WaitForPodFailedReason({0x7fae352fa698, 0xc0022f39b0}, {0x5aa1d18, 0xc001982e00}, 0xc0013bc008, {0x521b5d8, 0x1d}, 0x37e11d6000) k8s.io/kubernetes/test/e2e/framework/pod/wait.go:896 +0x147 k8s.io/kubernetes/test/e2e/storage/csimock.init.func16.2.3({0x7fae352fa698, 0xc0022f39b0}) k8s.io/kubernetes/test/e2e/storage/csimock/mutable_csinode_allocatable.go:214 +0x63b [FAILED] in [It] - k8s.io/kubernetes/test/e2e/storage/csimock/mutable_csinode_allocatable.go:215 @ 09/22/25 01:35:34.667 STEP: Deleting pod pvc-volume-tester-985ct @ 09/22/25 01:35:34.668 I0922 01:35:34.668220 17 delete.go:78] Deleting pod "pvc-volume-tester-985ct" in namespace "mutable-allocatable-mock-8613" I0922 01:35:34.674907 17 delete.go:86] Wait up to 5m0s for pod "pvc-volume-tester-985ct" to be fully deleted STEP: Deleting claim pvc-4gpbr @ 09/22/25 01:35:36.683 I0922 01:35:36.691975 17 pv.go:863] Waiting up to 2m0s for PersistentVolume pvc-2fee841a-7c7e-40ab-8b84-13ada77e3420 to get deleted I0922 01:35:36.695118 17 pv.go:867] PersistentVolume pvc-2fee841a-7c7e-40ab-8b84-13ada77e3420 found and phase=Bound (3.097202ms) I0922 01:35:38.699657 17 pv.go:867] PersistentVolume pvc-2fee841a-7c7e-40ab-8b84-13ada77e3420 found and phase=Released (2.007631905s) I0922 01:35:40.704071 17 pv.go:867] PersistentVolume pvc-2fee841a-7c7e-40ab-8b84-13ada77e3420 found and phase=Released (4.012048459s) I0922 01:35:42.708244 17 pv.go:867] PersistentVolume pvc-2fee841a-7c7e-40ab-8b84-13ada77e3420 found and phase=Released (6.01621916s) I0922 01:35:43.654561 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Controller/ControllerUnpublishVolume","Request":{"volume_id":"4","node_id":"csi-mock-mutable-allocatable-mock-8613"},"Response":{},"Error":"","FullError":null} I0922 01:35:43.719612 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Controller/DeleteVolume","Request":{"volume_id":"4"},"Response":{},"Error":"","FullError":null} I0922 01:35:43.740698 17 csi.go:489] gRPCCall: {"Method":"/csi.v1.Controller/DeleteVolume","Request":{"volume_id":"4"},"Response":{},"Error":"","FullError":null} I0922 01:35:44.711281 17 pv.go:871] PersistentVolume pvc-2fee841a-7c7e-40ab-8b84-13ada77e3420 was removed STEP: Deleting storageclass mutable-allocatable-mock-8613-scmjzrs @ 09/22/25 01:35:44.711 STEP: uninstalling csi mock driver @ 09/22/25 01:35:44.718 STEP: deleting the driver namespace: mutable-allocatable-mock-8613-4748 @ 09/22/25 01:35:44.718 STEP: Collecting events from namespace "mutable-allocatable-mock-8613-4748". @ 09/22/25 01:35:44.718 STEP: Found 19 events. @ 09/22/25 01:35:44.723 I0922 01:35:44.723915 17 dump.go:53] At 2025-09-22 01:31:25 +0000 UTC - event for csi-mockplugin: {statefulset-controller } SuccessfulCreate: create Pod csi-mockplugin-0 in StatefulSet csi-mockplugin successful I0922 01:35:44.723951 17 dump.go:53] At 2025-09-22 01:31:25 +0000 UTC - event for csi-mockplugin-0: {default-scheduler } Scheduled: Successfully assigned mutable-allocatable-mock-8613-4748/csi-mockplugin-0 to latest-worker2 I0922 01:35:44.723972 17 dump.go:53] At 2025-09-22 01:31:25 +0000 UTC - event for csi-mockplugin-attacher: {statefulset-controller } SuccessfulCreate: create Pod csi-mockplugin-attacher-0 in StatefulSet csi-mockplugin-attacher successful I0922 01:35:44.723989 17 dump.go:53] At 2025-09-22 01:31:25 +0000 UTC - event for csi-mockplugin-attacher-0: {default-scheduler } Scheduled: Successfully assigned mutable-allocatable-mock-8613-4748/csi-mockplugin-attacher-0 to latest-worker2 I0922 01:35:44.724009 17 dump.go:53] At 2025-09-22 01:31:26 +0000 UTC - event for csi-mockplugin-0: {kubelet latest-worker2} Created: Created container: mock I0922 01:35:44.724028 17 dump.go:53] At 2025-09-22 01:31:26 +0000 UTC - event for csi-mockplugin-0: {kubelet latest-worker2} Created: Created container: busybox I0922 01:35:44.724047 17 dump.go:53] At 2025-09-22 01:31:26 +0000 UTC - event for csi-mockplugin-0: {kubelet latest-worker2} Started: Started container driver-registrar I0922 01:35:44.724064 17 dump.go:53] At 2025-09-22 01:31:26 +0000 UTC - event for csi-mockplugin-0: {kubelet latest-worker2} Pulled: Container image "registry.k8s.io/sig-storage/hostpathplugin:v1.16.1" already present on machine I0922 01:35:44.724082 17 dump.go:53] At 2025-09-22 01:31:26 +0000 UTC - event for csi-mockplugin-0: {kubelet latest-worker2} Pulled: Container image "registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.13.0" already present on machine I0922 01:35:44.724101 17 dump.go:53] At 2025-09-22 01:31:26 +0000 UTC - event for csi-mockplugin-0: {kubelet latest-worker2} Started: Started container mock I0922 01:35:44.724116 17 dump.go:53] At 2025-09-22 01:31:26 +0000 UTC - event for csi-mockplugin-0: {kubelet latest-worker2} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.36.1-1" already present on machine I0922 01:35:44.724134 17 dump.go:53] At 2025-09-22 01:31:26 +0000 UTC - event for csi-mockplugin-0: {kubelet latest-worker2} Created: Created container: driver-registrar I0922 01:35:44.724152 17 dump.go:53] At 2025-09-22 01:31:26 +0000 UTC - event for csi-mockplugin-0: {kubelet latest-worker2} Started: Started container busybox I0922 01:35:44.724170 17 dump.go:53] At 2025-09-22 01:31:26 +0000 UTC - event for csi-mockplugin-0: {kubelet latest-worker2} Started: Started container csi-provisioner I0922 01:35:44.724188 17 dump.go:53] At 2025-09-22 01:31:26 +0000 UTC - event for csi-mockplugin-0: {kubelet latest-worker2} Pulled: Container image "registry.k8s.io/sig-storage/csi-provisioner:v5.1.0" already present on machine I0922 01:35:44.724206 17 dump.go:53] At 2025-09-22 01:31:26 +0000 UTC - event for csi-mockplugin-0: {kubelet latest-worker2} Created: Created container: csi-provisioner I0922 01:35:44.724223 17 dump.go:53] At 2025-09-22 01:31:26 +0000 UTC - event for csi-mockplugin-attacher-0: {kubelet latest-worker2} Started: Started container csi-attacher I0922 01:35:44.724241 17 dump.go:53] At 2025-09-22 01:31:26 +0000 UTC - event for csi-mockplugin-attacher-0: {kubelet latest-worker2} Created: Created container: csi-attacher I0922 01:35:44.724258 17 dump.go:53] At 2025-09-22 01:31:26 +0000 UTC - event for csi-mockplugin-attacher-0: {kubelet latest-worker2} Pulled: Container image "registry.k8s.io/sig-storage/csi-attacher:v4.8.0" already present on machine I0922 01:35:44.728685 17 resource.go:151] POD NODE PHASE GRACE CONDITIONS I0922 01:35:44.728775 17 resource.go:158] csi-mockplugin-0 latest-worker2 Running [{PodReadyToStartContainers 0 True 0001-01-01 00:00:00 +0000 UTC 2025-09-22 01:31:27 +0000 UTC } {Initialized 0 True 0001-01-01 00:00:00 +0000 UTC 2025-09-22 01:31:25 +0000 UTC } {Ready 0 True 0001-01-01 00:00:00 +0000 UTC 2025-09-22 01:31:30 +0000 UTC } {ContainersReady 0 True 0001-01-01 00:00:00 +0000 UTC 2025-09-22 01:31:30 +0000 UTC } {PodScheduled 0 True 0001-01-01 00:00:00 +0000 UTC 2025-09-22 01:31:25 +0000 UTC }] I0922 01:35:44.728827 17 resource.go:158] csi-mockplugin-attacher-0 latest-worker2 Running [{PodReadyToStartContainers 0 True 0001-01-01 00:00:00 +0000 UTC 2025-09-22 01:31:26 +0000 UTC } {Initialized 0 True 0001-01-01 00:00:00 +0000 UTC 2025-09-22 01:31:25 +0000 UTC } {Ready 0 True 0001-01-01 00:00:00 +0000 UTC 2025-09-22 01:31:31 +0000 UTC } {ContainersReady 0 True 0001-01-01 00:00:00 +0000 UTC 2025-09-22 01:31:31 +0000 UTC } {PodScheduled 0 True 0001-01-01 00:00:00 +0000 UTC 2025-09-22 01:31:25 +0000 UTC }] I0922 01:35:44.728846 17 resource.go:161] I0922 01:35:44.728865 17 resource.go:175] csi-mockplugin-0[mutable-allocatable-mock-8613-4748].container[csi-provisioner]=Lost connection to CSI driver, exiting I0922 01:35:44.728880 17 resource.go:175] csi-mockplugin-attacher-0[mutable-allocatable-mock-8613-4748].container[csi-attacher]=Lost connection to CSI driver, exiting I0922 01:35:44.793650 17 dump.go:109] Logging node info for node latest-control-plane I0922 01:35:44.797751 17 dump.go:114] Node Info: &Node{ObjectMeta:{latest-control-plane 4a88f68e-a233-4137-96e6-a4d02b8e46e1 5999943 0 2025-08-14 10:01:12 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:latest-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2025-08-14 10:01:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2025-08-14 10:01:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2025-08-14 10:01:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2025-09-22 01:35:23 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:runtimeHandlers":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/latest/latest-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67398062080 0} {} 65818420Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67398062080 0} {} 65818420Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2025-09-22 01:35:23 +0000 UTC,LastTransitionTime:2025-08-14 10:01:10 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2025-09-22 01:35:23 +0000 UTC,LastTransitionTime:2025-08-14 10:01:10 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2025-09-22 01:35:23 +0000 UTC,LastTransitionTime:2025-08-14 10:01:10 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2025-09-22 01:35:23 +0000 UTC,LastTransitionTime:2025-08-14 10:01:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.0.13,},NodeAddress{Type:Hostname,Address:latest-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:c7fda80d8f9641588679c7e1084a869f,SystemUUID:634ef398-8dbd-484b-881c-6c5a7cef3a32,BootID:505e7ca9-c9d0-4e24-a4f5-b43989aac371,KernelVersion:5.15.0-138-generic,OSImage:Debian GNU/Linux 12 (bookworm),ContainerRuntimeVersion:containerd://2.1.1,KubeletVersion:v1.33.1,KubeProxyVersion:,OperatingSystem:linux,Architecture:amd64,Swap:&NodeSwapStatus{Capacity:*1023406080,},},Images:[]ContainerImage{ContainerImage{Names:[docker.io/sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 docker.io/sirot/netperf-latest:latest],SizeBytes:118405146,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.33.1 registry.k8s.io/kube-apiserver:v1.33.1],SizeBytes:102853105,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.33.1 registry.k8s.io/kube-proxy:v1.33.1],SizeBytes:99143369,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.33.1 registry.k8s.io/kube-controller-manager:v1.33.1],SizeBytes:95652183,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.33.1 registry.k8s.io/kube-scheduler:v1.33.1],SizeBytes:74496343,},ContainerImage{Names:[docker.io/aquasec/kube-bench@sha256:d079de1fa7f757b367c39ee12eafc0e8729e94962df2c29808f4b602a615c142 docker.io/aquasec/kube-bench:latest],SizeBytes:62003820,},ContainerImage{Names:[docker.io/aquasec/kube-bench@sha256:e68c8040406b92b9df6566bd140523da57e12d5bf0a193ba985526050ddb4e87],SizeBytes:60365666,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.21-0],SizeBytes:58938593,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20250512-df8de77b],SizeBytes:44375501,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v20250214-acbabc1a],SizeBytes:22540870,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.12.0],SizeBytes:20939036,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20241212-8ac705d0],SizeBytes:3084671,},ContainerImage{Names:[docker.io/library/alpine@sha256:66790a2b79e1ea3e1dabac43990c54aca5d1ddf268d9a5a0285e4167c8b24475 docker.io/library/alpine:3.6],SizeBytes:2021226,},ContainerImage{Names:[registry.k8s.io/pause@sha256:278fb9dbcca9518083ad1e11276933a2e96f23de604a3a08cc3c80002767d24c registry.k8s.io/pause:3.10.1],SizeBytes:320448,},ContainerImage{Names:[registry.k8s.io/pause:3.10],SizeBytes:320368,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,RuntimeHandlers:[]NodeRuntimeHandler{NodeRuntimeHandler{Name:runc,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},NodeRuntimeHandler{Name:,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},NodeRuntimeHandler{Name:test-handler,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},},Features:&NodeFeatures{SupplementalGroupsPolicy:*true,},},} I0922 01:35:44.797824 17 dump.go:116] Logging kubelet events for node latest-control-plane I0922 01:35:44.801124 17 dump.go:121] Logging pods the kubelet thinks are on node latest-control-plane I0922 01:35:44.830882 17 dump.go:128] kube-system/coredns-674b8bbfcf-2h8qn started at 2025-08-14 10:01:35 +0000 UTC (0+1 container statuses recorded) I0922 01:35:44.830917 17 dump.go:134] Container coredns ready: true, restart count 0 I0922 01:35:44.830940 17 dump.go:128] kube-system/etcd-latest-control-plane started at 2025-08-14 10:01:15 +0000 UTC (0+1 container statuses recorded) I0922 01:35:44.830958 17 dump.go:134] Container etcd ready: true, restart count 0 I0922 01:35:44.830982 17 dump.go:128] kube-system/kube-apiserver-latest-control-plane started at 2025-08-14 10:01:15 +0000 UTC (0+1 container statuses recorded) I0922 01:35:44.831002 17 dump.go:134] Container kube-apiserver ready: true, restart count 0 I0922 01:35:44.831027 17 dump.go:128] kube-system/kube-controller-manager-latest-control-plane started at 2025-08-14 10:01:15 +0000 UTC (0+1 container statuses recorded) I0922 01:35:44.831048 17 dump.go:134] Container kube-controller-manager ready: true, restart count 0 I0922 01:35:44.831070 17 dump.go:128] kube-system/kube-scheduler-latest-control-plane started at 2025-08-14 10:01:15 +0000 UTC (0+1 container statuses recorded) I0922 01:35:44.831088 17 dump.go:134] Container kube-scheduler ready: true, restart count 0 I0922 01:35:44.831110 17 dump.go:128] kube-system/kindnet-qc9kz started at 2025-08-14 10:01:20 +0000 UTC (0+1 container statuses recorded) I0922 01:35:44.831129 17 dump.go:134] Container kindnet-cni ready: true, restart count 0 I0922 01:35:44.831151 17 dump.go:128] kube-system/coredns-674b8bbfcf-klpkw started at 2025-08-14 10:01:35 +0000 UTC (0+1 container statuses recorded) I0922 01:35:44.831169 17 dump.go:134] Container coredns ready: true, restart count 0 I0922 01:35:44.831191 17 dump.go:128] local-path-storage/local-path-provisioner-7dc846544d-kfzml started at 2025-08-14 10:01:35 +0000 UTC (0+1 container statuses recorded) I0922 01:35:44.831209 17 dump.go:134] Container local-path-provisioner ready: true, restart count 0 I0922 01:35:44.831229 17 dump.go:128] kube-system/kube-proxy-pmhrl started at 2025-08-14 10:01:20 +0000 UTC (0+1 container statuses recorded) I0922 01:35:44.831247 17 dump.go:134] Container kube-proxy ready: true, restart count 0 I0922 01:35:44.831264 17 dump.go:128] kube-system/create-loop-devs-mbrb2 started at 2025-08-14 10:01:25 +0000 UTC (0+1 container statuses recorded) I0922 01:35:44.831282 17 dump.go:134] Container loopdev ready: true, restart count 0 I0922 01:35:44.899059 17 kubelet_metrics.go:206] Latency metrics for node latest-control-plane I0922 01:35:44.899098 17 dump.go:109] Logging node info for node latest-worker I0922 01:35:44.903649 17 dump.go:114] Node Info: &Node{ObjectMeta:{latest-worker 8c88dec8-b208-4951-9edb-9daf6e60cfed 6000557 0 2025-08-14 10:01:24 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:latest-worker kubernetes.io/os:linux topology.hostpath.csi/node:latest-worker] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-fsgroup-policy-146":"latest-worker"} kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2025-08-14 10:01:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2025-08-14 10:01:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2025-09-15 02:53:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {kubelet Update v1 2025-09-22 01:35:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:runtimeHandlers":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/latest/latest-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67398062080 0} {} 65818420Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67398062080 0} {} 65818420Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2025-09-22 01:35:16 +0000 UTC,LastTransitionTime:2025-08-14 10:01:24 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2025-09-22 01:35:16 +0000 UTC,LastTransitionTime:2025-08-14 10:01:24 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2025-09-22 01:35:16 +0000 UTC,LastTransitionTime:2025-08-14 10:01:24 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2025-09-22 01:35:16 +0000 UTC,LastTransitionTime:2025-08-14 10:01:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.0.12,},NodeAddress{Type:Hostname,Address:latest-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f7df88837db5436386878b8262a14e32,SystemUUID:7f723078-9e20-4c29-be13-6b3e065907c6,BootID:505e7ca9-c9d0-4e24-a4f5-b43989aac371,KernelVersion:5.15.0-138-generic,OSImage:Debian GNU/Linux 12 (bookworm),ContainerRuntimeVersion:containerd://2.1.1,KubeletVersion:v1.33.1,KubeProxyVersion:,OperatingSystem:linux,Architecture:amd64,Swap:&NodeSwapStatus{Capacity:*1023406080,},},Images:[]ContainerImage{ContainerImage{Names:[docker.io/lfncnti/cluster-tools@sha256:906f9b2c15b6f64d83c52bf9efd108b434d311fb548ac20abcfb815981e741b6 docker.io/lfncnti/cluster-tools:v1.0.8],SizeBytes:466650686,},ContainerImage{Names:[docker.io/ollivier/clearwater-cassandra@sha256:7460a5e29c91e16bd36534b5284b27832e1c6e0f7c22a4bb79eda79942d250e1 docker.io/ollivier/clearwater-cassandra:hunter],SizeBytes:386500834,},ContainerImage{Names:[docker.io/ollivier/clearwater-homestead-prov@sha256:ef3803b4336ea217f9a467dac7f5c4bc3d2cd0f3cbbcc6c101419506fc3a6fa4 docker.io/ollivier/clearwater-homestead-prov:hunter],SizeBytes:360721934,},ContainerImage{Names:[docker.io/ollivier/clearwater-astaire@sha256:5bc730435563dc3e31f3a3b7bb58b5899c453929b624052622b3a9a1c2fd04d8 docker.io/ollivier/clearwater-astaire:hunter],SizeBytes:327310970,},ContainerImage{Names:[docker.io/ollivier/clearwater-bono@sha256:0da41ddbf72c158f8e617015450587634cdf6856696005601b2108df92a27254 docker.io/ollivier/clearwater-bono:hunter],SizeBytes:303708624,},ContainerImage{Names:[docker.io/ollivier/clearwater-homestead@sha256:8467d6c9caefa6a402eba927ee31f8179b2dc3386ac4768dd04f4bd630a1b9e9 docker.io/ollivier/clearwater-homestead:hunter],SizeBytes:295167572,},ContainerImage{Names:[litmuschaos.docker.scarf.sh/litmuschaos/go-runner@sha256:4664e5d3eba9f9f805900045fc632dd4f35d96b9a744800c0eade4fde45de681 litmuschaos.docker.scarf.sh/litmuschaos/go-runner:3.6.0],SizeBytes:190137665,},ContainerImage{Names:[docker.io/library/docker@sha256:c0872aae4791ff427e6eda52769afa04f17b5cf756f8267e0d52774c99d5c9de docker.io/library/docker:dind],SizeBytes:145422022,},ContainerImage{Names:[docker.io/sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 docker.io/sirot/netperf-latest:latest],SizeBytes:118405146,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.33.1 registry.k8s.io/kube-apiserver:v1.33.1],SizeBytes:102853105,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.33.1 registry.k8s.io/kube-proxy:v1.33.1],SizeBytes:99143369,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.33.1 registry.k8s.io/kube-controller-manager:v1.33.1],SizeBytes:95652183,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:c825f3d5e28bde099bd7a3daace28772d412c9157ad47fa752a9ad0baafc118d registry.k8s.io/sig-storage/nfs-provisioner:v4.0.8],SizeBytes:91036984,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.33.1 registry.k8s.io/kube-scheduler:v1.33.1],SizeBytes:74496343,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:e36c081683425b5b3bc1425bc508b37e7107bb65dfa9367bf5a80125d431fa19 registry.k8s.io/etcd:3.6.4-0],SizeBytes:74311308,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.21-0],SizeBytes:58938593,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:352a050380078cb2a1c246357a0dfa2fcf243ee416b92ff28b44a01d1b4b0294 registry.k8s.io/e2e-test-images/agnhost:2.56],SizeBytes:55898458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper@sha256:60c11972feffb389c42762ab7ba596dcbfe88aed032b9c4a9cb9adedaaf8a35c docker.io/openpolicyagent/gatekeeper:v3.20.0],SizeBytes:46856023,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper@sha256:6fda2898bdbdb9d446ce71b1f6bfe0efad87076025989642b5d151c17fd9a77c docker.io/openpolicyagent/gatekeeper:v3.20.1],SizeBytes:44884438,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20250512-df8de77b],SizeBytes:44375501,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:19d4ecf1e0731b9ea55aca9c070d520f68b96ed0defbcc0e4eefe97b3d663ca3 registry.k8s.io/e2e-test-images/sample-apiserver:1.29.2],SizeBytes:39672997,},ContainerImage{Names:[docker.io/ollivier/clearwater-live-test@sha256:1ec1c46f531b5466e62e2a3f1e65e97336e8ea0ca50f11a4305775d6aeac9a58 docker.io/ollivier/clearwater-live-test:hunter],SizeBytes:39060692,},ContainerImage{Names:[docker.io/aquasec/kube-hunter@sha256:885520da54150bd9d133b30d59df645fdc5a06644809d987e1d3c707c3dd2aaf docker.io/aquasec/kube-hunter:latest],SizeBytes:38278209,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:2a0b297cc7c4cd376ac7413df339ff2fdaa1ec9d099aed92b5ea1f031ef7f639 registry.k8s.io/sig-storage/csi-resizer:v1.13.1],SizeBytes:32400950,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:a399393ff5bd156277c56bae0c08389b1a1b95b7fd6ea44a316ce55e0dd559d7 registry.k8s.io/sig-storage/csi-attacher:v4.8.0],SizeBytes:32231444,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:672e45d6a55678abc1d102de665b5cbd63848e75dc7896f238c8eaaf3c7d322f registry.k8s.io/sig-storage/csi-provisioner:v5.1.0],SizeBytes:32167411,},ContainerImage{Names:[litmuschaos.docker.scarf.sh/litmuschaos/chaos-operator@sha256:f37e85afc0412a47d1e028e5f86b6cc3a8cbbfe59369beba0af5401aa47dfd63 litmuschaos.docker.scarf.sh/litmuschaos/chaos-operator:3.6.0],SizeBytes:29032757,},ContainerImage{Names:[litmuschaos.docker.scarf.sh/litmuschaos/chaos-runner@sha256:a762f650ce60ab0698c79e4b646c941933fab46837c69a0a888addb6bda0ccb6 litmuschaos.docker.scarf.sh/litmuschaos/chaos-runner:3.6.0],SizeBytes:27151116,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v20250214-acbabc1a],SizeBytes:22540870,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.12.0],SizeBytes:20939036,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:65192845eeac8e24a708f865911776a0d8490ab886e78dad17e80ae1870e7410 registry.k8s.io/sig-storage/hostpathplugin:v1.16.1],SizeBytes:20349620,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper-crds@sha256:011fadc314224fa0dccb59b3770ae3f355c31ae512bbcbb3ca4a362c7d616622 docker.io/openpolicyagent/gatekeeper-crds:v3.20.1],SizeBytes:18120390,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper-crds@sha256:d60ccbbfb53422fd0af71486ed5171343f741e9e7ef9fa4dea86719e684d5e54 docker.io/openpolicyagent/gatekeeper-crds:v3.20.0],SizeBytes:17993290,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:f6602cc2b5a2ff2138db48546d727e72599cd14021cdc5309142f407f5d43969 quay.io/coreos/etcd:v3.2.32],SizeBytes:16250306,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:d7138bcc3aa5f267403d45ad4292c95397e421ea17a0035888850f424c7de25d registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.13.0],SizeBytes:14781503,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:2c8d61c46f484d881db43b34d13ca47a269336e576c81cf007ca740fa9ec0800 docker.io/coredns/coredns:1.6.7],SizeBytes:13598515,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:cc8fb77bc2a0541949d1d9320a641b82fd392b0d3d8145469ca4709ae769980e docker.io/coredns/coredns:1.8.0],SizeBytes:12945155,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:4a6e0769130686518325b21b0c1d0688b54e7c79244d48e1b15634e98e40c6ef docker.io/coredns/coredns:1.7.1],SizeBytes:12935701,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:9d12cad5c4a1a4c1a853947ae4cbf31a860f98bb450173fee644d8e63ce6ea4d registry.k8s.io/build-image/distroless-iptables:v0.7.7],SizeBytes:11558416,},ContainerImage{Names:[docker.io/curlimages/curl@sha256:3dfa70a646c5d03ddf0e7c0ff518a5661e95b8bcbc82079f0fb7453a96eaae35 docker.io/curlimages/curl:8.12.0],SizeBytes:10048754,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:4381769,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20241212-8ac705d0],SizeBytes:3084671,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,RuntimeHandlers:[]NodeRuntimeHandler{NodeRuntimeHandler{Name:runc,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},NodeRuntimeHandler{Name:,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},NodeRuntimeHandler{Name:test-handler,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},},Features:&NodeFeatures{SupplementalGroupsPolicy:*true,},},} I0922 01:35:44.903714 17 dump.go:116] Logging kubelet events for node latest-worker I0922 01:35:44.906770 17 dump.go:121] Logging pods the kubelet thinks are on node latest-worker I0922 01:35:44.922361 17 dump.go:128] configmap-6713/pod-configmaps-f0690e7f-1a47-4667-8bfa-d28af75ebb56 started at 2025-09-22 01:35:13 +0000 UTC (0+1 container statuses recorded) I0922 01:35:44.922391 17 dump.go:134] Container agnhost-container ready: false, restart count 0 I0922 01:35:44.922407 17 dump.go:128] host-path-type-directory-4019/test-hostpath-type-mtmfr started at 2025-09-22 01:35:41 +0000 UTC (0+1 container statuses recorded) I0922 01:35:44.922421 17 dump.go:134] Container host-path-testing ready: true, restart count 0 I0922 01:35:44.922437 17 dump.go:128] projected-1016/pod-configmaps-fb25bf8a-8b94-45d8-bfd3-67f5032eb6e6 started at 2025-09-22 01:33:29 +0000 UTC (0+1 container statuses recorded) I0922 01:35:44.922448 17 dump.go:134] Container agnhost-container ready: false, restart count 0 I0922 01:35:44.922461 17 dump.go:128] host-path-type-directory-4019/test-hostpath-type-pq7h4 started at 2025-09-22 01:35:43 +0000 UTC (0+1 container statuses recorded) I0922 01:35:44.922474 17 dump.go:134] Container host-path-testing ready: false, restart count 0 I0922 01:35:44.922485 17 dump.go:128] host-path-type-socket-534/test-hostpath-type-nzqz5 started at 2025-09-22 01:35:37 +0000 UTC (0+1 container statuses recorded) I0922 01:35:44.922496 17 dump.go:134] Container host-path-sh-testing ready: true, restart count 0 I0922 01:35:44.922508 17 dump.go:128] kube-system/kube-proxy-plcq4 started at 2025-08-14 10:01:24 +0000 UTC (0+1 container statuses recorded) I0922 01:35:44.922518 17 dump.go:134] Container kube-proxy ready: true, restart count 0 I0922 01:35:44.922530 17 dump.go:128] csi-mock-volumes-fsgroup-policy-146-7414/csi-mockplugin-0 started at 2025-09-22 01:35:37 +0000 UTC (0+3 container statuses recorded) I0922 01:35:44.922541 17 dump.go:134] Container csi-provisioner ready: true, restart count 0 I0922 01:35:44.922554 17 dump.go:134] Container driver-registrar ready: true, restart count 0 I0922 01:35:44.922565 17 dump.go:134] Container mock ready: true, restart count 0 I0922 01:35:44.922581 17 dump.go:128] kube-system/kindnet-kcb5w started at 2025-08-14 10:01:24 +0000 UTC (0+1 container statuses recorded) I0922 01:35:44.922591 17 dump.go:134] Container kindnet-cni ready: true, restart count 0 I0922 01:35:44.922601 17 dump.go:128] kube-system/create-loop-devs-76ng2 started at 2025-08-14 10:01:25 +0000 UTC (0+1 container statuses recorded) I0922 01:35:44.922615 17 dump.go:134] Container loopdev ready: true, restart count 0 I0922 01:35:44.922652 17 dump.go:128] projected-5743/pod-secrets-709169c8-f9d3-4f9b-85b5-8f4cda0b6231 started at 2025-09-22 01:34:46 +0000 UTC (0+1 container statuses recorded) I0922 01:35:44.922668 17 dump.go:134] Container creates-volume-test ready: false, restart count 0 I0922 01:35:44.922679 17 dump.go:128] persistent-local-volumes-test-8331/hostexec-latest-worker-hzq4w started at 2025-09-22 01:35:25 +0000 UTC (0+1 container statuses recorded) I0922 01:35:44.922689 17 dump.go:134] Container agnhost-container ready: true, restart count 0 I0922 01:35:44.922700 17 dump.go:128] persistent-local-volumes-test-6482/hostexec-latest-worker-25c6j started at 2025-09-22 01:35:30 +0000 UTC (0+1 container statuses recorded) I0922 01:35:44.922710 17 dump.go:134] Container agnhost-container ready: true, restart count 0 I0922 01:35:44.922719 17 dump.go:128] csi-mock-volumes-fsgroup-policy-146/pvc-volume-tester-4twjs started at 2025-09-22 01:35:44 +0000 UTC (0+1 container statuses recorded) I0922 01:35:44.922729 17 dump.go:134] Container volume-tester ready: false, restart count 0 I0922 01:35:44.922740 17 dump.go:128] persistent-local-volumes-test-5249/pod-d920fa2c-701f-4902-8b2b-b1d7164bf92e started at 2025-09-22 01:32:45 +0000 UTC (0+1 container statuses recorded) I0922 01:35:44.922752 17 dump.go:134] Container write-pod ready: false, restart count 0 I0922 01:35:45.614963 17 kubelet_metrics.go:206] Latency metrics for node latest-worker I0922 01:35:45.614994 17 dump.go:109] Logging node info for node latest-worker2 I0922 01:35:45.619133 17 dump.go:114] Node Info: &Node{ObjectMeta:{latest-worker2 3d1774a3-1fed-4ae4-9649-579167a82d96 6000725 0 2025-08-14 10:01:24 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:latest-worker2 kubernetes.io/os:linux topology.hostpath.csi/node:latest-worker2] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-expansion-7456":"csi-mock-csi-mock-volumes-expansion-7456","csi-mock-csi-mock-volumes-workload-2962":"latest-worker2","csi-mock-mutable-allocatable-mock-8613":"csi-mock-mutable-allocatable-mock-8613"} kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2025-08-14 10:01:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2025-08-14 10:01:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2025-09-08 02:54:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kube-controller-manager Update v1 2025-09-22 01:35:36 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2025-09-22 01:35:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:runtimeHandlers":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/latest/latest-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67398062080 0} {} 65818420Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67398062080 0} {} 65818420Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2025-09-22 01:35:43 +0000 UTC,LastTransitionTime:2025-08-14 10:01:24 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2025-09-22 01:35:43 +0000 UTC,LastTransitionTime:2025-08-14 10:01:24 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2025-09-22 01:35:43 +0000 UTC,LastTransitionTime:2025-08-14 10:01:24 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2025-09-22 01:35:43 +0000 UTC,LastTransitionTime:2025-08-14 10:01:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.0.11,},NodeAddress{Type:Hostname,Address:latest-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:53b074234c804259ae0ff2cba6a6f050,SystemUUID:0c517cb0-5dd6-4327-a0bd-07b70f744e34,BootID:505e7ca9-c9d0-4e24-a4f5-b43989aac371,KernelVersion:5.15.0-138-generic,OSImage:Debian GNU/Linux 12 (bookworm),ContainerRuntimeVersion:containerd://2.1.1,KubeletVersion:v1.33.1,KubeProxyVersion:,OperatingSystem:linux,Architecture:amd64,Swap:&NodeSwapStatus{Capacity:*1023406080,},},Images:[]ContainerImage{ContainerImage{Names:[docker.io/lfncnti/cluster-tools@sha256:906f9b2c15b6f64d83c52bf9efd108b434d311fb548ac20abcfb815981e741b6 docker.io/lfncnti/cluster-tools:v1.0.8],SizeBytes:466650686,},ContainerImage{Names:[docker.io/ollivier/clearwater-ellis@sha256:abcaf4a9ec74aa746f3b3949f05ee359349fce2b0b3b2deedf67164719cff5dc docker.io/ollivier/clearwater-ellis:hunter],SizeBytes:351519591,},ContainerImage{Names:[docker.io/ollivier/clearwater-homer@sha256:f8738d756137990120f6aafca7e0bc57186ab591a4b51508ba9ddf30688f4de1 docker.io/ollivier/clearwater-homer:hunter],SizeBytes:344304298,},ContainerImage{Names:[docker.io/ollivier/clearwater-sprout@sha256:fd91f90bdfbfac30288ca296962e36537f8fa311d34711904e027098227d9f49 docker.io/ollivier/clearwater-sprout:hunter],SizeBytes:298627136,},ContainerImage{Names:[docker.io/ollivier/clearwater-ralf@sha256:7054a741dbd4ea45fa4efd8138c07e21d35fbed627971559de5df2d03883e94f docker.io/ollivier/clearwater-ralf:hunter],SizeBytes:287441316,},ContainerImage{Names:[docker.io/ollivier/clearwater-chronos@sha256:1d5f9b5385db632e3076463fec5a4db5d4a15ef21ac5a112cb42fb0551ffa36d docker.io/ollivier/clearwater-chronos:hunter],SizeBytes:285504787,},ContainerImage{Names:[litmuschaos.docker.scarf.sh/litmuschaos/go-runner@sha256:4664e5d3eba9f9f805900045fc632dd4f35d96b9a744800c0eade4fde45de681 litmuschaos.docker.scarf.sh/litmuschaos/go-runner:3.6.0],SizeBytes:190137665,},ContainerImage{Names:[docker.io/library/docker@sha256:831644212c5bdd0b3362b5855c87b980ea39a83c9e9adcef2ce03eced99a737a docker.io/library/docker:dind],SizeBytes:148417865,},ContainerImage{Names:[docker.io/sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 docker.io/sirot/netperf-latest:latest],SizeBytes:118405146,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.33.1 registry.k8s.io/kube-apiserver:v1.33.1],SizeBytes:102853105,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.33.1 registry.k8s.io/kube-proxy:v1.33.1],SizeBytes:99143369,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.33.1 registry.k8s.io/kube-controller-manager:v1.33.1],SizeBytes:95652183,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:c825f3d5e28bde099bd7a3daace28772d412c9157ad47fa752a9ad0baafc118d registry.k8s.io/sig-storage/nfs-provisioner:v4.0.8],SizeBytes:91036984,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.33.1 registry.k8s.io/kube-scheduler:v1.33.1],SizeBytes:74496343,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:e36c081683425b5b3bc1425bc508b37e7107bb65dfa9367bf5a80125d431fa19 registry.k8s.io/etcd:3.6.4-0],SizeBytes:74311308,},ContainerImage{Names:[docker.io/aquasec/kube-bench@sha256:d079de1fa7f757b367c39ee12eafc0e8729e94962df2c29808f4b602a615c142 docker.io/aquasec/kube-bench:latest],SizeBytes:62003820,},ContainerImage{Names:[docker.io/aquasec/kube-bench@sha256:e68c8040406b92b9df6566bd140523da57e12d5bf0a193ba985526050ddb4e87],SizeBytes:60365666,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.21-0],SizeBytes:58938593,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:352a050380078cb2a1c246357a0dfa2fcf243ee416b92ff28b44a01d1b4b0294 registry.k8s.io/e2e-test-images/agnhost:2.56],SizeBytes:55898458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper@sha256:60c11972feffb389c42762ab7ba596dcbfe88aed032b9c4a9cb9adedaaf8a35c docker.io/openpolicyagent/gatekeeper:v3.20.0],SizeBytes:46856023,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper@sha256:6fda2898bdbdb9d446ce71b1f6bfe0efad87076025989642b5d151c17fd9a77c docker.io/openpolicyagent/gatekeeper:v3.20.1],SizeBytes:44884438,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20250512-df8de77b],SizeBytes:44375501,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:19d4ecf1e0731b9ea55aca9c070d520f68b96ed0defbcc0e4eefe97b3d663ca3 registry.k8s.io/e2e-test-images/sample-apiserver:1.29.2],SizeBytes:39672997,},ContainerImage{Names:[docker.io/ollivier/clearwater-live-test@sha256:1ec1c46f531b5466e62e2a3f1e65e97336e8ea0ca50f11a4305775d6aeac9a58 docker.io/ollivier/clearwater-live-test:hunter],SizeBytes:39060692,},ContainerImage{Names:[docker.io/aquasec/kube-hunter@sha256:885520da54150bd9d133b30d59df645fdc5a06644809d987e1d3c707c3dd2aaf docker.io/aquasec/kube-hunter:latest],SizeBytes:38278209,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:2a0b297cc7c4cd376ac7413df339ff2fdaa1ec9d099aed92b5ea1f031ef7f639 registry.k8s.io/sig-storage/csi-resizer:v1.13.1],SizeBytes:32400950,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:a399393ff5bd156277c56bae0c08389b1a1b95b7fd6ea44a316ce55e0dd559d7 registry.k8s.io/sig-storage/csi-attacher:v4.8.0],SizeBytes:32231444,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:672e45d6a55678abc1d102de665b5cbd63848e75dc7896f238c8eaaf3c7d322f registry.k8s.io/sig-storage/csi-provisioner:v5.1.0],SizeBytes:32167411,},ContainerImage{Names:[litmuschaos.docker.scarf.sh/litmuschaos/chaos-operator@sha256:f37e85afc0412a47d1e028e5f86b6cc3a8cbbfe59369beba0af5401aa47dfd63 litmuschaos.docker.scarf.sh/litmuschaos/chaos-operator:3.6.0],SizeBytes:29032757,},ContainerImage{Names:[litmuschaos.docker.scarf.sh/litmuschaos/chaos-runner@sha256:a762f650ce60ab0698c79e4b646c941933fab46837c69a0a888addb6bda0ccb6 litmuschaos.docker.scarf.sh/litmuschaos/chaos-runner:3.6.0],SizeBytes:27151116,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v20250214-acbabc1a],SizeBytes:22540870,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.12.0],SizeBytes:20939036,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:65192845eeac8e24a708f865911776a0d8490ab886e78dad17e80ae1870e7410 registry.k8s.io/sig-storage/hostpathplugin:v1.16.1],SizeBytes:20349620,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper-crds@sha256:011fadc314224fa0dccb59b3770ae3f355c31ae512bbcbb3ca4a362c7d616622 docker.io/openpolicyagent/gatekeeper-crds:v3.20.1],SizeBytes:18120390,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper-crds@sha256:d60ccbbfb53422fd0af71486ed5171343f741e9e7ef9fa4dea86719e684d5e54 docker.io/openpolicyagent/gatekeeper-crds:v3.20.0],SizeBytes:17993290,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:f6602cc2b5a2ff2138db48546d727e72599cd14021cdc5309142f407f5d43969 quay.io/coreos/etcd:v3.2.32],SizeBytes:16250306,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:d7138bcc3aa5f267403d45ad4292c95397e421ea17a0035888850f424c7de25d registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.13.0],SizeBytes:14781503,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:2c8d61c46f484d881db43b34d13ca47a269336e576c81cf007ca740fa9ec0800 docker.io/coredns/coredns:1.6.7],SizeBytes:13598515,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:cc8fb77bc2a0541949d1d9320a641b82fd392b0d3d8145469ca4709ae769980e docker.io/coredns/coredns:1.8.0],SizeBytes:12945155,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:4a6e0769130686518325b21b0c1d0688b54e7c79244d48e1b15634e98e40c6ef docker.io/coredns/coredns:1.7.1],SizeBytes:12935701,},ContainerImage{Names:[docker.io/curlimages/curl@sha256:3dfa70a646c5d03ddf0e7c0ff518a5661e95b8bcbc82079f0fb7453a96eaae35 docker.io/curlimages/curl:8.12.0],SizeBytes:10048754,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:4381769,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-expansion-7456^4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-expansion-7456^4,DevicePath:,},},Config:nil,RuntimeHandlers:[]NodeRuntimeHandler{NodeRuntimeHandler{Name:test-handler,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},NodeRuntimeHandler{Name:runc,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},NodeRuntimeHandler{Name:,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},},Features:&NodeFeatures{SupplementalGroupsPolicy:*true,},},} I0922 01:35:45.619354 17 dump.go:116] Logging kubelet events for node latest-worker2 I0922 01:35:45.621910 17 dump.go:121] Logging pods the kubelet thinks are on node latest-worker2 I0922 01:35:45.640949 17 dump.go:128] csi-mock-volumes-workload-2962-9248/csi-mockplugin-attacher-0 started at 2025-09-22 01:35:40 +0000 UTC (0+1 container statuses recorded) I0922 01:35:45.640984 17 dump.go:134] Container csi-attacher ready: true, restart count 0 I0922 01:35:45.641009 17 dump.go:128] csi-mock-volumes-workload-2962-9248/csi-mockplugin-0 started at 2025-09-22 01:35:40 +0000 UTC (0+3 container statuses recorded) I0922 01:35:45.641029 17 dump.go:134] Container csi-provisioner ready: true, restart count 0 I0922 01:35:45.641049 17 dump.go:134] Container driver-registrar ready: true, restart count 0 I0922 01:35:45.641065 17 dump.go:134] Container mock ready: true, restart count 0 I0922 01:35:45.641086 17 dump.go:128] kube-system/kindnet-pthkx started at 2025-08-14 10:01:24 +0000 UTC (0+1 container statuses recorded) I0922 01:35:45.641105 17 dump.go:134] Container kindnet-cni ready: true, restart count 0 I0922 01:35:45.641126 17 dump.go:128] persistent-local-volumes-test-5386/hostexec-latest-worker2-prvj6 started at 2025-09-22 01:35:40 +0000 UTC (0+1 container statuses recorded) I0922 01:35:45.641141 17 dump.go:134] Container agnhost-container ready: true, restart count 0 I0922 01:35:45.641162 17 dump.go:128] kube-system/kube-proxy-splj6 started at 2025-08-14 10:01:24 +0000 UTC (0+1 container statuses recorded) I0922 01:35:45.641177 17 dump.go:134] Container kube-proxy ready: true, restart count 0 I0922 01:35:45.641199 17 dump.go:128] csi-mock-volumes-expansion-7456/pvc-volume-tester-wzhdz started at 2025-09-22 01:35:35 +0000 UTC (0+1 container statuses recorded) I0922 01:35:45.641217 17 dump.go:134] Container volume-tester ready: false, restart count 0 I0922 01:35:45.641238 17 dump.go:128] mutable-allocatable-mock-8613-4748/csi-mockplugin-0 started at 2025-09-22 01:31:25 +0000 UTC (0+4 container statuses recorded) I0922 01:35:45.641253 17 dump.go:134] Container busybox ready: true, restart count 0 I0922 01:35:45.641273 17 dump.go:134] Container csi-provisioner ready: true, restart count 1 I0922 01:35:45.641292 17 dump.go:134] Container driver-registrar ready: true, restart count 0 I0922 01:35:45.641311 17 dump.go:134] Container mock ready: true, restart count 0 I0922 01:35:45.641331 17 dump.go:128] csi-mock-volumes-expansion-7456-8494/csi-mockplugin-0 started at 2025-09-22 01:35:28 +0000 UTC (0+4 container statuses recorded) I0922 01:35:45.641349 17 dump.go:134] Container busybox ready: true, restart count 0 I0922 01:35:45.641364 17 dump.go:134] Container csi-provisioner ready: true, restart count 1 I0922 01:35:45.641382 17 dump.go:134] Container driver-registrar ready: true, restart count 0 I0922 01:35:45.641400 17 dump.go:134] Container mock ready: true, restart count 0 I0922 01:35:45.641420 17 dump.go:128] persistent-local-volumes-test-5386/pod-01f2a0c3-00cd-484f-ab78-f4a906591d2b started at 2025-09-22 01:35:44 +0000 UTC (0+1 container statuses recorded) I0922 01:35:45.641438 17 dump.go:134] Container write-pod ready: false, restart count 0 I0922 01:35:45.641458 17 dump.go:128] mutable-allocatable-mock-8613-4748/csi-mockplugin-attacher-0 started at 2025-09-22 01:31:25 +0000 UTC (0+1 container statuses recorded) I0922 01:35:45.641476 17 dump.go:134] Container csi-attacher ready: true, restart count 1 I0922 01:35:45.641496 17 dump.go:128] csi-mock-volumes-expansion-7456-8494/csi-mockplugin-attacher-0 started at 2025-09-22 01:35:28 +0000 UTC (0+1 container statuses recorded) I0922 01:35:45.641513 17 dump.go:134] Container csi-attacher ready: true, restart count 1 I0922 01:35:45.641534 17 dump.go:128] kube-system/create-loop-devs-pw6dk started at 2025-08-14 10:01:25 +0000 UTC (0+1 container statuses recorded) I0922 01:35:45.641552 17 dump.go:134] Container loopdev ready: true, restart count 0 I0922 01:35:45.641573 17 dump.go:128] csi-mock-volumes-expansion-7456-8494/csi-mockplugin-resizer-0 started at 2025-09-22 01:35:28 +0000 UTC (0+1 container statuses recorded) I0922 01:35:45.641591 17 dump.go:134] Container csi-resizer ready: true, restart count 1 I0922 01:35:46.346174 17 kubelet_metrics.go:206] Latency metrics for node latest-worker2 STEP: Waiting for namespaces [mutable-allocatable-mock-8613-4748] to vanish @ 09/22/25 01:35:46.351 I0922 01:36:30.495406 17 helper.go:125] Waiting up to 7m0s for all (but 0) nodes to be ready STEP: dump namespace information after failure @ 09/22/25 01:36:30.5 STEP: Collecting events from namespace "mutable-allocatable-mock-8613". @ 09/22/25 01:36:30.5 STEP: Found 6 events. @ 09/22/25 01:36:30.504 I0922 01:36:30.504658 17 dump.go:53] At 2025-09-22 01:31:30 +0000 UTC - event for pvc-4gpbr: {persistentvolume-controller } ExternalProvisioning: Waiting for a volume to be created either by the external provisioner 'csi-mock-mutable-allocatable-mock-8613' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. I0922 01:36:30.504691 17 dump.go:53] At 2025-09-22 01:31:30 +0000 UTC - event for pvc-4gpbr: {csi-mock-mutable-allocatable-mock-8613_csi-mockplugin-0_929760dd-0c5f-4df4-be04-fa59608cfc09 } Provisioning: External provisioner is provisioning volume for claim "mutable-allocatable-mock-8613/pvc-4gpbr" I0922 01:36:30.504713 17 dump.go:53] At 2025-09-22 01:31:30 +0000 UTC - event for pvc-4gpbr: {csi-mock-mutable-allocatable-mock-8613_csi-mockplugin-0_929760dd-0c5f-4df4-be04-fa59608cfc09 } ProvisioningSucceeded: Successfully provisioned volume pvc-2fee841a-7c7e-40ab-8b84-13ada77e3420 I0922 01:36:30.504733 17 dump.go:53] At 2025-09-22 01:31:32 +0000 UTC - event for pvc-volume-tester-985ct: {default-scheduler } Scheduled: Successfully assigned mutable-allocatable-mock-8613/pvc-volume-tester-985ct to latest-worker2 I0922 01:36:30.504753 17 dump.go:53] At 2025-09-22 01:31:33 +0000 UTC - event for pvc-volume-tester-985ct: {attachdetach-controller } FailedAttachVolume: AttachVolume.Attach failed for volume "pvc-2fee841a-7c7e-40ab-8b84-13ada77e3420" : rpc error: code = ResourceExhausted desc = attachment limit exceeded I0922 01:36:30.504775 17 dump.go:53] At 2025-09-22 01:31:35 +0000 UTC - event for pvc-volume-tester-985ct: {attachdetach-controller } FailedAttachVolume: AttachVolume.Attach failed for volume "pvc-2fee841a-7c7e-40ab-8b84-13ada77e3420" : ResourceExhausted: attachment limit exceeded I0922 01:36:30.508282 17 resource.go:151] POD NODE PHASE GRACE CONDITIONS I0922 01:36:30.508318 17 resource.go:161] I0922 01:36:30.512034 17 dump.go:109] Logging node info for node latest-control-plane I0922 01:36:30.515834 17 dump.go:114] Node Info: &Node{ObjectMeta:{latest-control-plane 4a88f68e-a233-4137-96e6-a4d02b8e46e1 5999943 0 2025-08-14 10:01:12 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:latest-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2025-08-14 10:01:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2025-08-14 10:01:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2025-08-14 10:01:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2025-09-22 01:35:23 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:runtimeHandlers":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/latest/latest-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67398062080 0} {} 65818420Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67398062080 0} {} 65818420Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2025-09-22 01:35:23 +0000 UTC,LastTransitionTime:2025-08-14 10:01:10 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2025-09-22 01:35:23 +0000 UTC,LastTransitionTime:2025-08-14 10:01:10 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2025-09-22 01:35:23 +0000 UTC,LastTransitionTime:2025-08-14 10:01:10 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2025-09-22 01:35:23 +0000 UTC,LastTransitionTime:2025-08-14 10:01:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.0.13,},NodeAddress{Type:Hostname,Address:latest-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:c7fda80d8f9641588679c7e1084a869f,SystemUUID:634ef398-8dbd-484b-881c-6c5a7cef3a32,BootID:505e7ca9-c9d0-4e24-a4f5-b43989aac371,KernelVersion:5.15.0-138-generic,OSImage:Debian GNU/Linux 12 (bookworm),ContainerRuntimeVersion:containerd://2.1.1,KubeletVersion:v1.33.1,KubeProxyVersion:,OperatingSystem:linux,Architecture:amd64,Swap:&NodeSwapStatus{Capacity:*1023406080,},},Images:[]ContainerImage{ContainerImage{Names:[docker.io/sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 docker.io/sirot/netperf-latest:latest],SizeBytes:118405146,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.33.1 registry.k8s.io/kube-apiserver:v1.33.1],SizeBytes:102853105,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.33.1 registry.k8s.io/kube-proxy:v1.33.1],SizeBytes:99143369,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.33.1 registry.k8s.io/kube-controller-manager:v1.33.1],SizeBytes:95652183,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.33.1 registry.k8s.io/kube-scheduler:v1.33.1],SizeBytes:74496343,},ContainerImage{Names:[docker.io/aquasec/kube-bench@sha256:d079de1fa7f757b367c39ee12eafc0e8729e94962df2c29808f4b602a615c142 docker.io/aquasec/kube-bench:latest],SizeBytes:62003820,},ContainerImage{Names:[docker.io/aquasec/kube-bench@sha256:e68c8040406b92b9df6566bd140523da57e12d5bf0a193ba985526050ddb4e87],SizeBytes:60365666,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.21-0],SizeBytes:58938593,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20250512-df8de77b],SizeBytes:44375501,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v20250214-acbabc1a],SizeBytes:22540870,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.12.0],SizeBytes:20939036,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20241212-8ac705d0],SizeBytes:3084671,},ContainerImage{Names:[docker.io/library/alpine@sha256:66790a2b79e1ea3e1dabac43990c54aca5d1ddf268d9a5a0285e4167c8b24475 docker.io/library/alpine:3.6],SizeBytes:2021226,},ContainerImage{Names:[registry.k8s.io/pause@sha256:278fb9dbcca9518083ad1e11276933a2e96f23de604a3a08cc3c80002767d24c registry.k8s.io/pause:3.10.1],SizeBytes:320448,},ContainerImage{Names:[registry.k8s.io/pause:3.10],SizeBytes:320368,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,RuntimeHandlers:[]NodeRuntimeHandler{NodeRuntimeHandler{Name:runc,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},NodeRuntimeHandler{Name:,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},NodeRuntimeHandler{Name:test-handler,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},},Features:&NodeFeatures{SupplementalGroupsPolicy:*true,},},} I0922 01:36:30.515885 17 dump.go:116] Logging kubelet events for node latest-control-plane I0922 01:36:30.519660 17 dump.go:121] Logging pods the kubelet thinks are on node latest-control-plane I0922 01:36:30.533749 17 dump.go:128] kube-system/etcd-latest-control-plane started at 2025-08-14 10:01:15 +0000 UTC (0+1 container statuses recorded) I0922 01:36:30.533788 17 dump.go:134] Container etcd ready: true, restart count 0 I0922 01:36:30.533814 17 dump.go:128] kube-system/kube-apiserver-latest-control-plane started at 2025-08-14 10:01:15 +0000 UTC (0+1 container statuses recorded) I0922 01:36:30.533835 17 dump.go:134] Container kube-apiserver ready: true, restart count 0 I0922 01:36:30.533858 17 dump.go:128] kube-system/kube-controller-manager-latest-control-plane started at 2025-08-14 10:01:15 +0000 UTC (0+1 container statuses recorded) I0922 01:36:30.533878 17 dump.go:134] Container kube-controller-manager ready: true, restart count 0 I0922 01:36:30.533901 17 dump.go:128] kube-system/kube-scheduler-latest-control-plane started at 2025-08-14 10:01:15 +0000 UTC (0+1 container statuses recorded) I0922 01:36:30.533920 17 dump.go:134] Container kube-scheduler ready: true, restart count 0 I0922 01:36:30.533942 17 dump.go:128] kube-system/kindnet-qc9kz started at 2025-08-14 10:01:20 +0000 UTC (0+1 container statuses recorded) I0922 01:36:30.533960 17 dump.go:134] Container kindnet-cni ready: true, restart count 0 I0922 01:36:30.533981 17 dump.go:128] kube-system/coredns-674b8bbfcf-klpkw started at 2025-08-14 10:01:35 +0000 UTC (0+1 container statuses recorded) I0922 01:36:30.534000 17 dump.go:134] Container coredns ready: true, restart count 0 I0922 01:36:30.534021 17 dump.go:128] local-path-storage/local-path-provisioner-7dc846544d-kfzml started at 2025-08-14 10:01:35 +0000 UTC (0+1 container statuses recorded) I0922 01:36:30.534041 17 dump.go:134] Container local-path-provisioner ready: true, restart count 0 I0922 01:36:30.534062 17 dump.go:128] kube-system/kube-proxy-pmhrl started at 2025-08-14 10:01:20 +0000 UTC (0+1 container statuses recorded) I0922 01:36:30.534081 17 dump.go:134] Container kube-proxy ready: true, restart count 0 I0922 01:36:30.534102 17 dump.go:128] kube-system/create-loop-devs-mbrb2 started at 2025-08-14 10:01:25 +0000 UTC (0+1 container statuses recorded) I0922 01:36:30.534120 17 dump.go:134] Container loopdev ready: true, restart count 0 I0922 01:36:30.534141 17 dump.go:128] kube-system/coredns-674b8bbfcf-2h8qn started at 2025-08-14 10:01:35 +0000 UTC (0+1 container statuses recorded) I0922 01:36:30.534159 17 dump.go:134] Container coredns ready: true, restart count 0 I0922 01:36:30.619379 17 kubelet_metrics.go:206] Latency metrics for node latest-control-plane I0922 01:36:30.619425 17 dump.go:109] Logging node info for node latest-worker I0922 01:36:30.624269 17 dump.go:114] Node Info: &Node{ObjectMeta:{latest-worker 8c88dec8-b208-4951-9edb-9daf6e60cfed 6001211 0 2025-08-14 10:01:24 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:latest-worker kubernetes.io/os:linux topology.hostpath.csi/node:latest-worker] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-fsgroup-policy-146":"latest-worker"} kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2025-08-14 10:01:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2025-08-14 10:01:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2025-09-15 02:53:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {kubelet Update v1 2025-09-22 01:36:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:runtimeHandlers":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/latest/latest-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67398062080 0} {} 65818420Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67398062080 0} {} 65818420Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2025-09-22 01:36:07 +0000 UTC,LastTransitionTime:2025-08-14 10:01:24 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2025-09-22 01:36:07 +0000 UTC,LastTransitionTime:2025-08-14 10:01:24 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2025-09-22 01:36:07 +0000 UTC,LastTransitionTime:2025-08-14 10:01:24 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2025-09-22 01:36:07 +0000 UTC,LastTransitionTime:2025-08-14 10:01:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.0.12,},NodeAddress{Type:Hostname,Address:latest-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f7df88837db5436386878b8262a14e32,SystemUUID:7f723078-9e20-4c29-be13-6b3e065907c6,BootID:505e7ca9-c9d0-4e24-a4f5-b43989aac371,KernelVersion:5.15.0-138-generic,OSImage:Debian GNU/Linux 12 (bookworm),ContainerRuntimeVersion:containerd://2.1.1,KubeletVersion:v1.33.1,KubeProxyVersion:,OperatingSystem:linux,Architecture:amd64,Swap:&NodeSwapStatus{Capacity:*1023406080,},},Images:[]ContainerImage{ContainerImage{Names:[docker.io/lfncnti/cluster-tools@sha256:906f9b2c15b6f64d83c52bf9efd108b434d311fb548ac20abcfb815981e741b6 docker.io/lfncnti/cluster-tools:v1.0.8],SizeBytes:466650686,},ContainerImage{Names:[docker.io/ollivier/clearwater-cassandra@sha256:7460a5e29c91e16bd36534b5284b27832e1c6e0f7c22a4bb79eda79942d250e1 docker.io/ollivier/clearwater-cassandra:hunter],SizeBytes:386500834,},ContainerImage{Names:[docker.io/ollivier/clearwater-homestead-prov@sha256:ef3803b4336ea217f9a467dac7f5c4bc3d2cd0f3cbbcc6c101419506fc3a6fa4 docker.io/ollivier/clearwater-homestead-prov:hunter],SizeBytes:360721934,},ContainerImage{Names:[docker.io/ollivier/clearwater-astaire@sha256:5bc730435563dc3e31f3a3b7bb58b5899c453929b624052622b3a9a1c2fd04d8 docker.io/ollivier/clearwater-astaire:hunter],SizeBytes:327310970,},ContainerImage{Names:[docker.io/ollivier/clearwater-bono@sha256:0da41ddbf72c158f8e617015450587634cdf6856696005601b2108df92a27254 docker.io/ollivier/clearwater-bono:hunter],SizeBytes:303708624,},ContainerImage{Names:[docker.io/ollivier/clearwater-homestead@sha256:8467d6c9caefa6a402eba927ee31f8179b2dc3386ac4768dd04f4bd630a1b9e9 docker.io/ollivier/clearwater-homestead:hunter],SizeBytes:295167572,},ContainerImage{Names:[litmuschaos.docker.scarf.sh/litmuschaos/go-runner@sha256:4664e5d3eba9f9f805900045fc632dd4f35d96b9a744800c0eade4fde45de681 litmuschaos.docker.scarf.sh/litmuschaos/go-runner:3.6.0],SizeBytes:190137665,},ContainerImage{Names:[docker.io/library/docker@sha256:c0872aae4791ff427e6eda52769afa04f17b5cf756f8267e0d52774c99d5c9de docker.io/library/docker:dind],SizeBytes:145422022,},ContainerImage{Names:[docker.io/sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 docker.io/sirot/netperf-latest:latest],SizeBytes:118405146,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.33.1 registry.k8s.io/kube-apiserver:v1.33.1],SizeBytes:102853105,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.33.1 registry.k8s.io/kube-proxy:v1.33.1],SizeBytes:99143369,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.33.1 registry.k8s.io/kube-controller-manager:v1.33.1],SizeBytes:95652183,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:c825f3d5e28bde099bd7a3daace28772d412c9157ad47fa752a9ad0baafc118d registry.k8s.io/sig-storage/nfs-provisioner:v4.0.8],SizeBytes:91036984,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.33.1 registry.k8s.io/kube-scheduler:v1.33.1],SizeBytes:74496343,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:e36c081683425b5b3bc1425bc508b37e7107bb65dfa9367bf5a80125d431fa19 registry.k8s.io/etcd:3.6.4-0],SizeBytes:74311308,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.21-0],SizeBytes:58938593,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:352a050380078cb2a1c246357a0dfa2fcf243ee416b92ff28b44a01d1b4b0294 registry.k8s.io/e2e-test-images/agnhost:2.56],SizeBytes:55898458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper@sha256:60c11972feffb389c42762ab7ba596dcbfe88aed032b9c4a9cb9adedaaf8a35c docker.io/openpolicyagent/gatekeeper:v3.20.0],SizeBytes:46856023,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper@sha256:6fda2898bdbdb9d446ce71b1f6bfe0efad87076025989642b5d151c17fd9a77c docker.io/openpolicyagent/gatekeeper:v3.20.1],SizeBytes:44884438,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20250512-df8de77b],SizeBytes:44375501,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:19d4ecf1e0731b9ea55aca9c070d520f68b96ed0defbcc0e4eefe97b3d663ca3 registry.k8s.io/e2e-test-images/sample-apiserver:1.29.2],SizeBytes:39672997,},ContainerImage{Names:[docker.io/ollivier/clearwater-live-test@sha256:1ec1c46f531b5466e62e2a3f1e65e97336e8ea0ca50f11a4305775d6aeac9a58 docker.io/ollivier/clearwater-live-test:hunter],SizeBytes:39060692,},ContainerImage{Names:[docker.io/aquasec/kube-hunter@sha256:885520da54150bd9d133b30d59df645fdc5a06644809d987e1d3c707c3dd2aaf docker.io/aquasec/kube-hunter:latest],SizeBytes:38278209,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:2a0b297cc7c4cd376ac7413df339ff2fdaa1ec9d099aed92b5ea1f031ef7f639 registry.k8s.io/sig-storage/csi-resizer:v1.13.1],SizeBytes:32400950,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:a399393ff5bd156277c56bae0c08389b1a1b95b7fd6ea44a316ce55e0dd559d7 registry.k8s.io/sig-storage/csi-attacher:v4.8.0],SizeBytes:32231444,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:672e45d6a55678abc1d102de665b5cbd63848e75dc7896f238c8eaaf3c7d322f registry.k8s.io/sig-storage/csi-provisioner:v5.1.0],SizeBytes:32167411,},ContainerImage{Names:[litmuschaos.docker.scarf.sh/litmuschaos/chaos-operator@sha256:f37e85afc0412a47d1e028e5f86b6cc3a8cbbfe59369beba0af5401aa47dfd63 litmuschaos.docker.scarf.sh/litmuschaos/chaos-operator:3.6.0],SizeBytes:29032757,},ContainerImage{Names:[litmuschaos.docker.scarf.sh/litmuschaos/chaos-runner@sha256:a762f650ce60ab0698c79e4b646c941933fab46837c69a0a888addb6bda0ccb6 litmuschaos.docker.scarf.sh/litmuschaos/chaos-runner:3.6.0],SizeBytes:27151116,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v20250214-acbabc1a],SizeBytes:22540870,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.12.0],SizeBytes:20939036,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:65192845eeac8e24a708f865911776a0d8490ab886e78dad17e80ae1870e7410 registry.k8s.io/sig-storage/hostpathplugin:v1.16.1],SizeBytes:20349620,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper-crds@sha256:011fadc314224fa0dccb59b3770ae3f355c31ae512bbcbb3ca4a362c7d616622 docker.io/openpolicyagent/gatekeeper-crds:v3.20.1],SizeBytes:18120390,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper-crds@sha256:d60ccbbfb53422fd0af71486ed5171343f741e9e7ef9fa4dea86719e684d5e54 docker.io/openpolicyagent/gatekeeper-crds:v3.20.0],SizeBytes:17993290,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:f6602cc2b5a2ff2138db48546d727e72599cd14021cdc5309142f407f5d43969 quay.io/coreos/etcd:v3.2.32],SizeBytes:16250306,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:d7138bcc3aa5f267403d45ad4292c95397e421ea17a0035888850f424c7de25d registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.13.0],SizeBytes:14781503,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:2c8d61c46f484d881db43b34d13ca47a269336e576c81cf007ca740fa9ec0800 docker.io/coredns/coredns:1.6.7],SizeBytes:13598515,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:cc8fb77bc2a0541949d1d9320a641b82fd392b0d3d8145469ca4709ae769980e docker.io/coredns/coredns:1.8.0],SizeBytes:12945155,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:4a6e0769130686518325b21b0c1d0688b54e7c79244d48e1b15634e98e40c6ef docker.io/coredns/coredns:1.7.1],SizeBytes:12935701,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:9d12cad5c4a1a4c1a853947ae4cbf31a860f98bb450173fee644d8e63ce6ea4d registry.k8s.io/build-image/distroless-iptables:v0.7.7],SizeBytes:11558416,},ContainerImage{Names:[docker.io/curlimages/curl@sha256:3dfa70a646c5d03ddf0e7c0ff518a5661e95b8bcbc82079f0fb7453a96eaae35 docker.io/curlimages/curl:8.12.0],SizeBytes:10048754,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:4381769,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20241212-8ac705d0],SizeBytes:3084671,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,RuntimeHandlers:[]NodeRuntimeHandler{NodeRuntimeHandler{Name:runc,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},NodeRuntimeHandler{Name:,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},NodeRuntimeHandler{Name:test-handler,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},},Features:&NodeFeatures{SupplementalGroupsPolicy:*true,},},} I0922 01:36:30.624312 17 dump.go:116] Logging kubelet events for node latest-worker I0922 01:36:30.627538 17 dump.go:121] Logging pods the kubelet thinks are on node latest-worker I0922 01:36:30.641468 17 dump.go:128] configmap-6713/pod-configmaps-f0690e7f-1a47-4667-8bfa-d28af75ebb56 started at 2025-09-22 01:35:13 +0000 UTC (0+1 container statuses recorded) I0922 01:36:30.641503 17 dump.go:134] Container agnhost-container ready: false, restart count 0 I0922 01:36:30.641529 17 dump.go:128] projected-1016/pod-configmaps-fb25bf8a-8b94-45d8-bfd3-67f5032eb6e6 started at 2025-09-22 01:33:29 +0000 UTC (0+1 container statuses recorded) I0922 01:36:30.641549 17 dump.go:134] Container agnhost-container ready: false, restart count 0 I0922 01:36:30.641572 17 dump.go:128] pv-3561/pod-ephm-test-secret-rlfc started at 2025-09-22 01:36:23 +0000 UTC (0+1 container statuses recorded) I0922 01:36:30.641591 17 dump.go:134] Container test-container-subpath-secret-rlfc ready: false, restart count 0 I0922 01:36:30.641613 17 dump.go:128] kube-system/kube-proxy-plcq4 started at 2025-08-14 10:01:24 +0000 UTC (0+1 container statuses recorded) I0922 01:36:30.641632 17 dump.go:134] Container kube-proxy ready: true, restart count 0 I0922 01:36:30.641653 17 dump.go:128] csi-mock-volumes-fsgroup-policy-146-7414/csi-mockplugin-0 started at 2025-09-22 01:35:37 +0000 UTC (0+3 container statuses recorded) I0922 01:36:30.641673 17 dump.go:134] Container csi-provisioner ready: true, restart count 0 I0922 01:36:30.641692 17 dump.go:134] Container driver-registrar ready: true, restart count 0 I0922 01:36:30.641711 17 dump.go:134] Container mock ready: true, restart count 0 I0922 01:36:30.641732 17 dump.go:128] kube-system/kindnet-kcb5w started at 2025-08-14 10:01:24 +0000 UTC (0+1 container statuses recorded) I0922 01:36:30.641751 17 dump.go:134] Container kindnet-cni ready: true, restart count 0 I0922 01:36:30.641775 17 dump.go:128] kube-system/create-loop-devs-76ng2 started at 2025-08-14 10:01:25 +0000 UTC (0+1 container statuses recorded) I0922 01:36:30.641796 17 dump.go:134] Container loopdev ready: true, restart count 0 I0922 01:36:30.641818 17 dump.go:128] projected-5743/pod-secrets-709169c8-f9d3-4f9b-85b5-8f4cda0b6231 started at 2025-09-22 01:34:46 +0000 UTC (0+1 container statuses recorded) I0922 01:36:30.641838 17 dump.go:134] Container creates-volume-test ready: false, restart count 0 I0922 01:36:30.641856 17 dump.go:128] persistent-local-volumes-test-5249/pod-d920fa2c-701f-4902-8b2b-b1d7164bf92e started at 2025-09-22 01:32:45 +0000 UTC (0+1 container statuses recorded) I0922 01:36:30.641874 17 dump.go:134] Container write-pod ready: false, restart count 0 I0922 01:36:30.641896 17 dump.go:128] host-path-type-directory-9601/test-hostpath-type-dp8x8 started at 2025-09-22 01:36:28 +0000 UTC (0+1 container statuses recorded) I0922 01:36:30.641915 17 dump.go:134] Container host-path-testing ready: true, restart count 0 I0922 01:36:30.641936 17 dump.go:128] csi-mock-volumes-fsgroup-policy-146/pvc-volume-tester-f5v5x started at 2025-09-22 01:36:20 +0000 UTC (0+1 container statuses recorded) I0922 01:36:30.641956 17 dump.go:134] Container volume-tester ready: true, restart count 0 I0922 01:36:31.358689 17 kubelet_metrics.go:206] Latency metrics for node latest-worker I0922 01:36:31.358737 17 dump.go:109] Logging node info for node latest-worker2 I0922 01:36:31.363156 17 dump.go:114] Node Info: &Node{ObjectMeta:{latest-worker2 3d1774a3-1fed-4ae4-9649-579167a82d96 6001760 0 2025-08-14 10:01:24 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:latest-worker2 kubernetes.io/os:linux topology.hostpath.csi/node:latest-worker2] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-expansion-7404":"csi-mock-csi-mock-volumes-expansion-7404","csi-mock-csi-mock-volumes-expansion-7456":"csi-mock-csi-mock-volumes-expansion-7456"} kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2025-08-14 10:01:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2025-08-14 10:01:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2025-09-08 02:54:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kube-controller-manager Update v1 2025-09-22 01:36:04 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2025-09-22 01:36:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:runtimeHandlers":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/latest/latest-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67398062080 0} {} 65818420Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67398062080 0} {} 65818420Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2025-09-22 01:36:04 +0000 UTC,LastTransitionTime:2025-08-14 10:01:24 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2025-09-22 01:36:04 +0000 UTC,LastTransitionTime:2025-08-14 10:01:24 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2025-09-22 01:36:04 +0000 UTC,LastTransitionTime:2025-08-14 10:01:24 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2025-09-22 01:36:04 +0000 UTC,LastTransitionTime:2025-08-14 10:01:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.0.11,},NodeAddress{Type:Hostname,Address:latest-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:53b074234c804259ae0ff2cba6a6f050,SystemUUID:0c517cb0-5dd6-4327-a0bd-07b70f744e34,BootID:505e7ca9-c9d0-4e24-a4f5-b43989aac371,KernelVersion:5.15.0-138-generic,OSImage:Debian GNU/Linux 12 (bookworm),ContainerRuntimeVersion:containerd://2.1.1,KubeletVersion:v1.33.1,KubeProxyVersion:,OperatingSystem:linux,Architecture:amd64,Swap:&NodeSwapStatus{Capacity:*1023406080,},},Images:[]ContainerImage{ContainerImage{Names:[docker.io/lfncnti/cluster-tools@sha256:906f9b2c15b6f64d83c52bf9efd108b434d311fb548ac20abcfb815981e741b6 docker.io/lfncnti/cluster-tools:v1.0.8],SizeBytes:466650686,},ContainerImage{Names:[docker.io/ollivier/clearwater-ellis@sha256:abcaf4a9ec74aa746f3b3949f05ee359349fce2b0b3b2deedf67164719cff5dc docker.io/ollivier/clearwater-ellis:hunter],SizeBytes:351519591,},ContainerImage{Names:[docker.io/ollivier/clearwater-homer@sha256:f8738d756137990120f6aafca7e0bc57186ab591a4b51508ba9ddf30688f4de1 docker.io/ollivier/clearwater-homer:hunter],SizeBytes:344304298,},ContainerImage{Names:[docker.io/ollivier/clearwater-sprout@sha256:fd91f90bdfbfac30288ca296962e36537f8fa311d34711904e027098227d9f49 docker.io/ollivier/clearwater-sprout:hunter],SizeBytes:298627136,},ContainerImage{Names:[docker.io/ollivier/clearwater-ralf@sha256:7054a741dbd4ea45fa4efd8138c07e21d35fbed627971559de5df2d03883e94f docker.io/ollivier/clearwater-ralf:hunter],SizeBytes:287441316,},ContainerImage{Names:[docker.io/ollivier/clearwater-chronos@sha256:1d5f9b5385db632e3076463fec5a4db5d4a15ef21ac5a112cb42fb0551ffa36d docker.io/ollivier/clearwater-chronos:hunter],SizeBytes:285504787,},ContainerImage{Names:[litmuschaos.docker.scarf.sh/litmuschaos/go-runner@sha256:4664e5d3eba9f9f805900045fc632dd4f35d96b9a744800c0eade4fde45de681 litmuschaos.docker.scarf.sh/litmuschaos/go-runner:3.6.0],SizeBytes:190137665,},ContainerImage{Names:[docker.io/library/docker@sha256:831644212c5bdd0b3362b5855c87b980ea39a83c9e9adcef2ce03eced99a737a docker.io/library/docker:dind],SizeBytes:148417865,},ContainerImage{Names:[docker.io/sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 docker.io/sirot/netperf-latest:latest],SizeBytes:118405146,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.33.1 registry.k8s.io/kube-apiserver:v1.33.1],SizeBytes:102853105,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.33.1 registry.k8s.io/kube-proxy:v1.33.1],SizeBytes:99143369,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.33.1 registry.k8s.io/kube-controller-manager:v1.33.1],SizeBytes:95652183,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:c825f3d5e28bde099bd7a3daace28772d412c9157ad47fa752a9ad0baafc118d registry.k8s.io/sig-storage/nfs-provisioner:v4.0.8],SizeBytes:91036984,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.33.1 registry.k8s.io/kube-scheduler:v1.33.1],SizeBytes:74496343,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:e36c081683425b5b3bc1425bc508b37e7107bb65dfa9367bf5a80125d431fa19 registry.k8s.io/etcd:3.6.4-0],SizeBytes:74311308,},ContainerImage{Names:[docker.io/aquasec/kube-bench@sha256:d079de1fa7f757b367c39ee12eafc0e8729e94962df2c29808f4b602a615c142 docker.io/aquasec/kube-bench:latest],SizeBytes:62003820,},ContainerImage{Names:[docker.io/aquasec/kube-bench@sha256:e68c8040406b92b9df6566bd140523da57e12d5bf0a193ba985526050ddb4e87],SizeBytes:60365666,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.21-0],SizeBytes:58938593,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:352a050380078cb2a1c246357a0dfa2fcf243ee416b92ff28b44a01d1b4b0294 registry.k8s.io/e2e-test-images/agnhost:2.56],SizeBytes:55898458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper@sha256:60c11972feffb389c42762ab7ba596dcbfe88aed032b9c4a9cb9adedaaf8a35c docker.io/openpolicyagent/gatekeeper:v3.20.0],SizeBytes:46856023,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper@sha256:6fda2898bdbdb9d446ce71b1f6bfe0efad87076025989642b5d151c17fd9a77c docker.io/openpolicyagent/gatekeeper:v3.20.1],SizeBytes:44884438,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20250512-df8de77b],SizeBytes:44375501,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:19d4ecf1e0731b9ea55aca9c070d520f68b96ed0defbcc0e4eefe97b3d663ca3 registry.k8s.io/e2e-test-images/sample-apiserver:1.29.2],SizeBytes:39672997,},ContainerImage{Names:[docker.io/ollivier/clearwater-live-test@sha256:1ec1c46f531b5466e62e2a3f1e65e97336e8ea0ca50f11a4305775d6aeac9a58 docker.io/ollivier/clearwater-live-test:hunter],SizeBytes:39060692,},ContainerImage{Names:[docker.io/aquasec/kube-hunter@sha256:885520da54150bd9d133b30d59df645fdc5a06644809d987e1d3c707c3dd2aaf docker.io/aquasec/kube-hunter:latest],SizeBytes:38278209,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:2a0b297cc7c4cd376ac7413df339ff2fdaa1ec9d099aed92b5ea1f031ef7f639 registry.k8s.io/sig-storage/csi-resizer:v1.13.1],SizeBytes:32400950,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:a399393ff5bd156277c56bae0c08389b1a1b95b7fd6ea44a316ce55e0dd559d7 registry.k8s.io/sig-storage/csi-attacher:v4.8.0],SizeBytes:32231444,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:672e45d6a55678abc1d102de665b5cbd63848e75dc7896f238c8eaaf3c7d322f registry.k8s.io/sig-storage/csi-provisioner:v5.1.0],SizeBytes:32167411,},ContainerImage{Names:[litmuschaos.docker.scarf.sh/litmuschaos/chaos-operator@sha256:f37e85afc0412a47d1e028e5f86b6cc3a8cbbfe59369beba0af5401aa47dfd63 litmuschaos.docker.scarf.sh/litmuschaos/chaos-operator:3.6.0],SizeBytes:29032757,},ContainerImage{Names:[litmuschaos.docker.scarf.sh/litmuschaos/chaos-runner@sha256:a762f650ce60ab0698c79e4b646c941933fab46837c69a0a888addb6bda0ccb6 litmuschaos.docker.scarf.sh/litmuschaos/chaos-runner:3.6.0],SizeBytes:27151116,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v20250214-acbabc1a],SizeBytes:22540870,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.12.0],SizeBytes:20939036,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:65192845eeac8e24a708f865911776a0d8490ab886e78dad17e80ae1870e7410 registry.k8s.io/sig-storage/hostpathplugin:v1.16.1],SizeBytes:20349620,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper-crds@sha256:011fadc314224fa0dccb59b3770ae3f355c31ae512bbcbb3ca4a362c7d616622 docker.io/openpolicyagent/gatekeeper-crds:v3.20.1],SizeBytes:18120390,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper-crds@sha256:d60ccbbfb53422fd0af71486ed5171343f741e9e7ef9fa4dea86719e684d5e54 docker.io/openpolicyagent/gatekeeper-crds:v3.20.0],SizeBytes:17993290,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:f6602cc2b5a2ff2138db48546d727e72599cd14021cdc5309142f407f5d43969 quay.io/coreos/etcd:v3.2.32],SizeBytes:16250306,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:d7138bcc3aa5f267403d45ad4292c95397e421ea17a0035888850f424c7de25d registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.13.0],SizeBytes:14781503,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:2c8d61c46f484d881db43b34d13ca47a269336e576c81cf007ca740fa9ec0800 docker.io/coredns/coredns:1.6.7],SizeBytes:13598515,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:cc8fb77bc2a0541949d1d9320a641b82fd392b0d3d8145469ca4709ae769980e docker.io/coredns/coredns:1.8.0],SizeBytes:12945155,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:4a6e0769130686518325b21b0c1d0688b54e7c79244d48e1b15634e98e40c6ef docker.io/coredns/coredns:1.7.1],SizeBytes:12935701,},ContainerImage{Names:[docker.io/curlimages/curl@sha256:3dfa70a646c5d03ddf0e7c0ff518a5661e95b8bcbc82079f0fb7453a96eaae35 docker.io/curlimages/curl:8.12.0],SizeBytes:10048754,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:4381769,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-expansion-7456^4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-expansion-7456^4,DevicePath:,},},Config:nil,RuntimeHandlers:[]NodeRuntimeHandler{NodeRuntimeHandler{Name:test-handler,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},NodeRuntimeHandler{Name:runc,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},NodeRuntimeHandler{Name:,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},},Features:&NodeFeatures{SupplementalGroupsPolicy:*true,},},} I0922 01:36:31.363196 17 dump.go:116] Logging kubelet events for node latest-worker2 I0922 01:36:31.366357 17 dump.go:121] Logging pods the kubelet thinks are on node latest-worker2 I0922 01:36:31.381763 17 dump.go:128] csi-mock-volumes-expansion-7456-8494/csi-mockplugin-attacher-0 started at 2025-09-22 01:35:28 +0000 UTC (0+1 container statuses recorded) I0922 01:36:31.381798 17 dump.go:134] Container csi-attacher ready: true, restart count 1 I0922 01:36:31.381824 17 dump.go:128] kube-system/create-loop-devs-pw6dk started at 2025-08-14 10:01:25 +0000 UTC (0+1 container statuses recorded) I0922 01:36:31.381845 17 dump.go:134] Container loopdev ready: true, restart count 0 I0922 01:36:31.381868 17 dump.go:128] csi-mock-volumes-expansion-7456-8494/csi-mockplugin-resizer-0 started at 2025-09-22 01:35:28 +0000 UTC (0+1 container statuses recorded) I0922 01:36:31.381887 17 dump.go:134] Container csi-resizer ready: true, restart count 1 I0922 01:36:31.381912 17 dump.go:128] host-path-type-directory-7851/test-hostpath-type-7hn6b started at 2025-09-22 01:36:22 +0000 UTC (0+1 container statuses recorded) I0922 01:36:31.381931 17 dump.go:134] Container host-path-testing ready: true, restart count 0 I0922 01:36:31.381952 17 dump.go:128] kube-system/kindnet-pthkx started at 2025-08-14 10:01:24 +0000 UTC (0+1 container statuses recorded) I0922 01:36:31.381971 17 dump.go:134] Container kindnet-cni ready: true, restart count 0 I0922 01:36:31.381993 17 dump.go:128] kube-system/kube-proxy-splj6 started at 2025-08-14 10:01:24 +0000 UTC (0+1 container statuses recorded) I0922 01:36:31.382012 17 dump.go:134] Container kube-proxy ready: true, restart count 0 I0922 01:36:31.382033 17 dump.go:128] csi-mock-volumes-expansion-7404-7913/csi-mockplugin-0 started at 2025-09-22 01:36:24 +0000 UTC (0+4 container statuses recorded) I0922 01:36:31.382052 17 dump.go:134] Container busybox ready: true, restart count 0 I0922 01:36:31.382070 17 dump.go:134] Container csi-provisioner ready: true, restart count 1 I0922 01:36:31.382088 17 dump.go:134] Container driver-registrar ready: true, restart count 0 I0922 01:36:31.382107 17 dump.go:134] Container mock ready: true, restart count 0 I0922 01:36:31.382128 17 dump.go:128] csi-mock-volumes-expansion-7404-7913/csi-mockplugin-resizer-0 started at 2025-09-22 01:36:24 +0000 UTC (0+1 container statuses recorded) I0922 01:36:31.382144 17 dump.go:134] Container csi-resizer ready: true, restart count 1 I0922 01:36:31.382166 17 dump.go:128] csi-mock-volumes-expansion-7456/pvc-volume-tester-wzhdz started at 2025-09-22 01:35:35 +0000 UTC (0+1 container statuses recorded) I0922 01:36:31.382184 17 dump.go:134] Container volume-tester ready: true, restart count 0 I0922 01:36:31.382204 17 dump.go:128] csi-mock-volumes-expansion-7404-7913/csi-mockplugin-attacher-0 started at 2025-09-22 01:36:24 +0000 UTC (0+1 container statuses recorded) I0922 01:36:31.382223 17 dump.go:134] Container csi-attacher ready: true, restart count 1 I0922 01:36:31.382246 17 dump.go:128] csi-mock-volumes-expansion-7456-8494/csi-mockplugin-0 started at 2025-09-22 01:35:28 +0000 UTC (0+4 container statuses recorded) I0922 01:36:31.382264 17 dump.go:134] Container busybox ready: true, restart count 0 I0922 01:36:31.382284 17 dump.go:134] Container csi-provisioner ready: true, restart count 1 I0922 01:36:31.382303 17 dump.go:134] Container driver-registrar ready: true, restart count 0 I0922 01:36:31.382321 17 dump.go:134] Container mock ready: true, restart count 0 I0922 01:36:32.084655 17 kubelet_metrics.go:206] Latency metrics for node latest-worker2 STEP: Destroying namespace "mutable-allocatable-mock-8613" for this suite. @ 09/22/25 01:36:32.085 << Timeline [FAILED] Pod did not fail with VolumeAttachmentLimitExceeded: Timed out after 240.000s. expected pod to be failed with reason VolumeAttachmentLimitExceeded, got instead: <*v1.Pod | 0xc0027d4008>: metadata: creationTimestamp: "2025-09-22T01:31:32Z" generateName: pvc-volume-tester- generation: 1 managedFields: - apiVersion: v1 fieldsType: FieldsV1 fieldsV1: f:metadata: f:generateName: {} f:spec: f:affinity: .: {} f:nodeAffinity: .: {} f:requiredDuringSchedulingIgnoredDuringExecution: {} f:containers: k:{"name":"volume-tester"}: .: {} f:image: {} f:imagePullPolicy: {} f:name: {} f:resources: {} f:terminationMessagePath: {} f:terminationMessagePolicy: {} f:volumeMounts: .: {} k:{"mountPath":"/mnt/test"}: .: {} f:mountPath: {} f:name: {} f:dnsPolicy: {} f:enableServiceLinks: {} f:restartPolicy: {} f:schedulerName: {} f:securityContext: {} f:terminationGracePeriodSeconds: {} f:volumes: .: {} k:{"name":"my-volume"}: .: {} f:name: {} f:persistentVolumeClaim: .: {} f:claimName: {} manager: e2e.test operation: Update time: "2025-09-22T01:31:32Z" - apiVersion: v1 fieldsType: FieldsV1 fieldsV1: f:status: f:conditions: k:{"type":"ContainersReady"}: .: {} f:lastProbeTime: {} f:lastTransitionTime: {} f:message: {} f:reason: {} f:status: {} f:type: {} k:{"type":"Initialized"}: .: {} f:lastProbeTime: {} f:lastTransitionTime: {} f:status: {} f:type: {} k:{"type":"PodReadyToStartContainers"}: .: {} f:lastProbeTime: {} f:lastTransitionTime: {} f:status: {} f:type: {} k:{"type":"Ready"}: .: {} f:lastProbeTime: {} f:lastTransitionTime: {} f:message: {} f:reason: {} f:status: {} f:type: {} f:containerStatuses: {} f:hostIP: {} f:hostIPs: {} f:startTime: {} manager: kubelet operation: Update subresource: status time: "2025-09-22T01:31:32Z" name: pvc-volume-tester-985ct namespace: mutable-allocatable-mock-8613 resourceVersion: "5994056" uid: 03c7b63b-e7e9-40d5-abbb-78ea3497049e spec: affinity: nodeAffinity: requiredDuringSchedulingIgnoredDuringExecution: nodeSelectorTerms: - matchFields: - key: metadata.name operator: In values: - latest-worker2 containers: - image: registry.k8s.io/pause:3.10.1 imagePullPolicy: IfNotPresent name: volume-tester resources: {} terminationMessagePath: /dev/termination-log terminationMessagePolicy: File volumeMounts: - mountPath: /mnt/test name: my-volume - mountPath: /var/run/secrets/kubernetes.io/serviceaccount name: kube-api-access-6w4bj readOnly: true dnsPolicy: ClusterFirst enableServiceLinks: true nodeName: latest-worker2 preemptionPolicy: PreemptLowerPriority priority: 0 restartPolicy: Never schedulerName: default-scheduler securityContext: {} serviceAccount: default serviceAccountName: default terminationGracePeriodSeconds: 30 tolerations: - effect: NoExecute key: node.kubernetes.io/not-ready operator: Exists tolerationSeconds: 300 - effect: NoExecute key: node.kubernetes.io/unreachable operator: Exists tolerationSeconds: 300 volumes: - name: my-volume persistentVolumeClaim: claimName: pvc-4gpbr - name: kube-api-access-6w4bj projected: defaultMode: 420 sources: - serviceAccountToken: expirationSeconds: 3607 path: token - configMap: items: - key: ca.crt path: ca.crt name: kube-root-ca.crt - downwardAPI: items: - fieldRef: apiVersion: v1 fieldPath: metadata.namespace path: namespace status: conditions: - lastProbeTime: null lastTransitionTime: "2025-09-22T01:31:32Z" status: "False" type: PodReadyToStartContainers - lastProbeTime: null lastTransitionTime: "2025-09-22T01:31:32Z" status: "True" type: Initialized - lastProbeTime: null lastTransitionTime: "2025-09-22T01:31:32Z" message: 'containers with unready status: [volume-tester]' reason: ContainersNotReady status: "False" type: Ready - lastProbeTime: null lastTransitionTime: "2025-09-22T01:31:32Z" message: 'containers with unready status: [volume-tester]' reason: ContainersNotReady status: "False" type: ContainersReady - lastProbeTime: null lastTransitionTime: "2025-09-22T01:31:32Z" status: "True" type: PodScheduled containerStatuses: - image: registry.k8s.io/pause:3.10.1 imageID: "" lastState: {} name: volume-tester ready: false restartCount: 0 started: false state: waiting: reason: ContainerCreating volumeMounts: - mountPath: /mnt/test name: my-volume - mountPath: /var/run/secrets/kubernetes.io/serviceaccount name: kube-api-access-6w4bj readOnly: true recursiveReadOnly: Disabled hostIP: 172.20.0.11 hostIPs: - ip: 172.20.0.11 phase: Pending qosClass: BestEffort startTime: "2025-09-22T01:31:32Z" In [It] at: k8s.io/kubernetes/test/e2e/storage/csimock/mutable_csinode_allocatable.go:215 @ 09/22/25 01:35:34.667 ------------------------------ SSSSSSSSSSSSSSSSSSSSS•SSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSS•SSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSS•SSSSSSSSS•SSSSSSSSSSSSS•SSSSSSSSSSSSSSSSS•SSSSSSSSSS••SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSS•SSSSSSSSSSSSSSS•SSSSSS ------------------------------ • [FAILED] [83.603 seconds] [sig-storage] MutableCSINodeAllocatableCount [FeatureGate:MutableCSINodeAllocatableCount] [Beta] [Feature:OffByDefault] Dynamic Allocatable Count [It] should observe dynamic changes in CSINode allocatable count [sig-storage, FeatureGate:MutableCSINodeAllocatableCount, Beta, Feature:OffByDefault, BetaOffByDefault] k8s.io/kubernetes/test/e2e/storage/csimock/mutable_csinode_allocatable.go:108 Timeline >> STEP: Creating a kubernetes client @ 09/22/25 01:37:50.978 I0922 01:37:50.978794 25 util.go:454] >>> kubeConfig: /home/xtesting/.kube/config STEP: Building a namespace api object, basename mutable-allocatable-mock @ 09/22/25 01:37:50.98 STEP: Waiting for a default service account to be provisioned in namespace @ 09/22/25 01:37:50.989 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace @ 09/22/25 01:37:50.994 STEP: Building a driver namespace object, basename mutable-allocatable-mock-2145 @ 09/22/25 01:37:50.999 STEP: Waiting for a default service account to be provisioned in namespace @ 09/22/25 01:37:51.008 STEP: deploying csi mock proxy @ 09/22/25 01:37:51.012 I0922 01:37:51.081804 25 create.go:156] creating *v1.ServiceAccount: mutable-allocatable-mock-2145-9129/csi-attacher I0922 01:37:51.086291 25 create.go:156] creating *v1.ClusterRole: external-attacher-runner-mutable-allocatable-mock-2145 I0922 01:37:51.086314 25 create.go:425] Define cluster role external-attacher-runner-mutable-allocatable-mock-2145 I0922 01:37:51.091135 25 create.go:156] creating *v1.ClusterRoleBinding: csi-attacher-role-mutable-allocatable-mock-2145 I0922 01:37:51.095566 25 create.go:156] creating *v1.Role: mutable-allocatable-mock-2145-9129/external-attacher-cfg-mutable-allocatable-mock-2145 I0922 01:37:51.099689 25 create.go:156] creating *v1.RoleBinding: mutable-allocatable-mock-2145-9129/csi-attacher-role-cfg I0922 01:37:51.104619 25 create.go:156] creating *v1.ServiceAccount: mutable-allocatable-mock-2145-9129/csi-provisioner I0922 01:37:51.108821 25 create.go:156] creating *v1.ClusterRole: external-provisioner-runner-mutable-allocatable-mock-2145 I0922 01:37:51.108843 25 create.go:425] Define cluster role external-provisioner-runner-mutable-allocatable-mock-2145 I0922 01:37:51.113519 25 create.go:156] creating *v1.ClusterRoleBinding: csi-provisioner-role-mutable-allocatable-mock-2145 I0922 01:37:51.117618 25 create.go:156] creating *v1.Role: mutable-allocatable-mock-2145-9129/external-provisioner-cfg-mutable-allocatable-mock-2145 I0922 01:37:51.121911 25 create.go:156] creating *v1.RoleBinding: mutable-allocatable-mock-2145-9129/csi-provisioner-role-cfg I0922 01:37:51.126300 25 create.go:156] creating *v1.ServiceAccount: mutable-allocatable-mock-2145-9129/csi-resizer I0922 01:37:51.130669 25 create.go:156] creating *v1.ClusterRole: external-resizer-runner-mutable-allocatable-mock-2145 I0922 01:37:51.130689 25 create.go:425] Define cluster role external-resizer-runner-mutable-allocatable-mock-2145 I0922 01:37:51.135360 25 create.go:156] creating *v1.ClusterRoleBinding: csi-resizer-role-mutable-allocatable-mock-2145 I0922 01:37:51.140000 25 create.go:156] creating *v1.Role: mutable-allocatable-mock-2145-9129/external-resizer-cfg-mutable-allocatable-mock-2145 I0922 01:37:51.144293 25 create.go:156] creating *v1.RoleBinding: mutable-allocatable-mock-2145-9129/csi-resizer-role-cfg I0922 01:37:51.149402 25 create.go:156] creating *v1.ServiceAccount: mutable-allocatable-mock-2145-9129/csi-snapshotter I0922 01:37:51.153352 25 create.go:156] creating *v1.ClusterRole: external-snapshotter-runner-mutable-allocatable-mock-2145 I0922 01:37:51.153371 25 create.go:425] Define cluster role external-snapshotter-runner-mutable-allocatable-mock-2145 I0922 01:37:51.157597 25 create.go:156] creating *v1.ClusterRoleBinding: csi-snapshotter-role-mutable-allocatable-mock-2145 I0922 01:37:51.161692 25 create.go:156] creating *v1.Role: mutable-allocatable-mock-2145-9129/external-snapshotter-leaderelection-mutable-allocatable-mock-2145 I0922 01:37:51.165909 25 create.go:156] creating *v1.RoleBinding: mutable-allocatable-mock-2145-9129/external-snapshotter-leaderelection I0922 01:37:51.170285 25 create.go:156] creating *v1.ServiceAccount: mutable-allocatable-mock-2145-9129/csi-mock I0922 01:37:51.174227 25 create.go:156] creating *v1.ClusterRoleBinding: csi-controller-attacher-role-mutable-allocatable-mock-2145 I0922 01:37:51.178472 25 create.go:156] creating *v1.ClusterRoleBinding: csi-controller-provisioner-role-mutable-allocatable-mock-2145 I0922 01:37:51.182437 25 create.go:156] creating *v1.ClusterRoleBinding: csi-controller-cluster-driver-registrar-role-mutable-allocatable-mock-2145 I0922 01:37:51.186313 25 create.go:156] creating *v1.ClusterRoleBinding: psp-csi-controller-driver-registrar-role-mutable-allocatable-mock-2145 I0922 01:37:51.190690 25 create.go:156] creating *v1.ClusterRoleBinding: csi-controller-resizer-role-mutable-allocatable-mock-2145 I0922 01:37:51.194725 25 create.go:156] creating *v1.ClusterRoleBinding: csi-controller-snapshotter-role-mutable-allocatable-mock-2145 I0922 01:37:51.198775 25 create.go:156] creating *v1.StorageClass: csi-mock-sc-mutable-allocatable-mock-2145 I0922 01:37:51.202807 25 create.go:156] creating *v1.StatefulSet: mutable-allocatable-mock-2145-9129/csi-mockplugin I0922 01:37:51.209767 25 create.go:156] creating *v1.CSIDriver: csi-mock-mutable-allocatable-mock-2145 I0922 01:37:51.214577 25 create.go:156] creating *v1.StatefulSet: mutable-allocatable-mock-2145-9129/csi-mockplugin-attacher I0922 01:37:51.228345 25 csi.go:1010] waiting for CSIDriver csi-mock-mutable-allocatable-mock-2145 to register on node latest-worker2 I0922 01:37:54.715160 25 csi.go:489] gRPCCall: {"Method":"/csi.v1.Identity/GetPluginInfo","Request":{},"Response":{"name":"csi-mock-mutable-allocatable-mock-2145","vendor_version":"0.3.0","manifest":{"url":"https://github.com/kubernetes/kubernetes/tree/master/test/e2e/storage/drivers/csi-test/mock"}},"Error":"","FullError":null} I0922 01:37:55.602352 25 mutable_csinode_allocatable.go:82] NodeGetInfo called, setting MaxVolumesPerNode to 5 I0922 01:37:55.602462 25 csi.go:489] gRPCCall: {"Method":"/csi.v1.Node/NodeGetInfo","Request":{},"Response":{"node_id":"csi-mock-mutable-allocatable-mock-2145","max_volumes_per_node":5},"Error":"","FullError":null} I0922 01:37:55.727787 25 csi.go:489] gRPCCall: {"Method":"/csi.v1.Identity/Probe","Request":{},"Response":{"ready":{"value":true}},"Error":"","FullError":null} I0922 01:37:55.729521 25 csi.go:489] gRPCCall: {"Method":"/csi.v1.Identity/GetPluginInfo","Request":{},"Response":{"name":"csi-mock-mutable-allocatable-mock-2145","vendor_version":"0.3.0","manifest":{"url":"https://github.com/kubernetes/kubernetes/tree/master/test/e2e/storage/drivers/csi-test/mock"}},"Error":"","FullError":null} I0922 01:37:55.731182 25 csi.go:489] gRPCCall: {"Method":"/csi.v1.Identity/GetPluginCapabilities","Request":{},"Response":{"capabilities":[{"Type":{"Service":{"type":1}}},{"Type":{"VolumeExpansion":{"type":1}}}]},"Error":"","FullError":null} I0922 01:37:55.732705 25 csi.go:489] gRPCCall: {"Method":"/csi.v1.Controller/ControllerGetCapabilities","Request":{},"Response":{"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":4}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":8}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":12}}},{"Type":{"Rpc":{"type":11}}},{"Type":{"Rpc":{"type":14}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":9}}}]},"Error":"","FullError":null} I0922 01:37:55.919099 25 csi.go:489] gRPCCall: {"Method":"/csi.v1.Identity/Probe","Request":{},"Response":{"ready":{"value":true}},"Error":"","FullError":null} I0922 01:37:55.920729 25 csi.go:489] gRPCCall: {"Method":"/csi.v1.Identity/GetPluginInfo","Request":{},"Response":{"name":"csi-mock-mutable-allocatable-mock-2145","vendor_version":"0.3.0","manifest":{"url":"https://github.com/kubernetes/kubernetes/tree/master/test/e2e/storage/drivers/csi-test/mock"}},"Error":"","FullError":null} I0922 01:37:55.921909 25 csi.go:489] gRPCCall: {"Method":"/csi.v1.Identity/GetPluginCapabilities","Request":{},"Response":{"capabilities":[{"Type":{"Service":{"type":1}}},{"Type":{"VolumeExpansion":{"type":1}}}]},"Error":"","FullError":null} I0922 01:37:55.923099 25 csi.go:489] gRPCCall: {"Method":"/csi.v1.Controller/ControllerGetCapabilities","Request":{},"Response":{"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":4}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":8}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":12}}},{"Type":{"Rpc":{"type":11}}},{"Type":{"Rpc":{"type":14}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":9}}}]},"Error":"","FullError":null} I0922 01:37:56.026951 25 csi.go:489] gRPCCall: {"Method":"/csi.v1.Controller/ListVolumes","Request":{},"Response":{"entries":[{"volume":{"capacity_bytes":107374182400,"volume_id":"1","volume_context":{"name":"Mock Volume 1"}},"status":{"published_node_ids":["csi-mock-mutable-allocatable-mock-2145"],"volume_condition":{}}},{"volume":{"capacity_bytes":107374182400,"volume_id":"2","volume_context":{"name":"Mock Volume 2"}},"status":{"published_node_ids":["csi-mock-mutable-allocatable-mock-2145"],"volume_condition":{}}},{"volume":{"capacity_bytes":107374182400,"volume_id":"3","volume_context":{"name":"Mock Volume 3"}},"status":{"published_node_ids":["csi-mock-mutable-allocatable-mock-2145"],"volume_condition":{}}}]},"Error":"","FullError":null} I0922 01:37:56.240771 25 mutable_csinode_allocatable.go:109] Testing dynamic changes in CSINode allocatable count I0922 01:37:56.243661 25 mutable_csinode_allocatable.go:112] Initial MaxVolumesPerNode limit: 5 I0922 01:38:26.244470 25 mutable_csinode_allocatable.go:122] Unexpected error: CSINode allocatable count was not updated to 8 in time: : context deadline exceeded {} [FAILED] in [It] - k8s.io/kubernetes/test/e2e/storage/csimock/mutable_csinode_allocatable.go:122 @ 09/22/25 01:38:26.244 STEP: uninstalling csi mock driver @ 09/22/25 01:38:26.247 STEP: deleting the driver namespace: mutable-allocatable-mock-2145-9129 @ 09/22/25 01:38:26.247 STEP: Collecting events from namespace "mutable-allocatable-mock-2145-9129". @ 09/22/25 01:38:26.247 STEP: Found 19 events. @ 09/22/25 01:38:26.293 I0922 01:38:26.293846 25 dump.go:53] At 2025-09-22 01:37:51 +0000 UTC - event for csi-mockplugin: {statefulset-controller } SuccessfulCreate: create Pod csi-mockplugin-0 in StatefulSet csi-mockplugin successful I0922 01:38:26.293880 25 dump.go:53] At 2025-09-22 01:37:51 +0000 UTC - event for csi-mockplugin-0: {kubelet latest-worker2} Pulled: Container image "registry.k8s.io/sig-storage/csi-provisioner:v5.1.0" already present on machine I0922 01:38:26.293900 25 dump.go:53] At 2025-09-22 01:37:51 +0000 UTC - event for csi-mockplugin-0: {kubelet latest-worker2} Created: Created container: csi-provisioner I0922 01:38:26.293920 25 dump.go:53] At 2025-09-22 01:37:51 +0000 UTC - event for csi-mockplugin-0: {kubelet latest-worker2} Started: Started container csi-provisioner I0922 01:38:26.293941 25 dump.go:53] At 2025-09-22 01:37:51 +0000 UTC - event for csi-mockplugin-0: {kubelet latest-worker2} Pulled: Container image "registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.13.0" already present on machine I0922 01:38:26.293957 25 dump.go:53] At 2025-09-22 01:37:51 +0000 UTC - event for csi-mockplugin-0: {kubelet latest-worker2} Created: Created container: driver-registrar I0922 01:38:26.293973 25 dump.go:53] At 2025-09-22 01:37:51 +0000 UTC - event for csi-mockplugin-0: {default-scheduler } Scheduled: Successfully assigned mutable-allocatable-mock-2145-9129/csi-mockplugin-0 to latest-worker2 I0922 01:38:26.293991 25 dump.go:53] At 2025-09-22 01:37:51 +0000 UTC - event for csi-mockplugin-attacher: {statefulset-controller } SuccessfulCreate: create Pod csi-mockplugin-attacher-0 in StatefulSet csi-mockplugin-attacher successful I0922 01:38:26.294009 25 dump.go:53] At 2025-09-22 01:37:51 +0000 UTC - event for csi-mockplugin-attacher-0: {default-scheduler } Scheduled: Successfully assigned mutable-allocatable-mock-2145-9129/csi-mockplugin-attacher-0 to latest-worker2 I0922 01:38:26.294028 25 dump.go:53] At 2025-09-22 01:37:51 +0000 UTC - event for csi-mockplugin-attacher-0: {kubelet latest-worker2} Created: Created container: csi-attacher I0922 01:38:26.294043 25 dump.go:53] At 2025-09-22 01:37:51 +0000 UTC - event for csi-mockplugin-attacher-0: {kubelet latest-worker2} Pulled: Container image "registry.k8s.io/sig-storage/csi-attacher:v4.8.0" already present on machine I0922 01:38:26.294061 25 dump.go:53] At 2025-09-22 01:37:52 +0000 UTC - event for csi-mockplugin-0: {kubelet latest-worker2} Created: Created container: mock I0922 01:38:26.294079 25 dump.go:53] At 2025-09-22 01:37:52 +0000 UTC - event for csi-mockplugin-0: {kubelet latest-worker2} Started: Started container busybox I0922 01:38:26.294096 25 dump.go:53] At 2025-09-22 01:37:52 +0000 UTC - event for csi-mockplugin-0: {kubelet latest-worker2} Created: Created container: busybox I0922 01:38:26.294114 25 dump.go:53] At 2025-09-22 01:37:52 +0000 UTC - event for csi-mockplugin-0: {kubelet latest-worker2} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.36.1-1" already present on machine I0922 01:38:26.294133 25 dump.go:53] At 2025-09-22 01:37:52 +0000 UTC - event for csi-mockplugin-0: {kubelet latest-worker2} Started: Started container mock I0922 01:38:26.294152 25 dump.go:53] At 2025-09-22 01:37:52 +0000 UTC - event for csi-mockplugin-0: {kubelet latest-worker2} Pulled: Container image "registry.k8s.io/sig-storage/hostpathplugin:v1.16.1" already present on machine I0922 01:38:26.294170 25 dump.go:53] At 2025-09-22 01:37:52 +0000 UTC - event for csi-mockplugin-0: {kubelet latest-worker2} Started: Started container driver-registrar I0922 01:38:26.294188 25 dump.go:53] At 2025-09-22 01:37:52 +0000 UTC - event for csi-mockplugin-attacher-0: {kubelet latest-worker2} Started: Started container csi-attacher I0922 01:38:26.344016 25 resource.go:151] POD NODE PHASE GRACE CONDITIONS I0922 01:38:26.344105 25 resource.go:158] csi-mockplugin-0 latest-worker2 Running [{PodReadyToStartContainers 0 True 0001-01-01 00:00:00 +0000 UTC 2025-09-22 01:37:53 +0000 UTC } {Initialized 0 True 0001-01-01 00:00:00 +0000 UTC 2025-09-22 01:37:51 +0000 UTC } {Ready 0 True 0001-01-01 00:00:00 +0000 UTC 2025-09-22 01:37:56 +0000 UTC } {ContainersReady 0 True 0001-01-01 00:00:00 +0000 UTC 2025-09-22 01:37:56 +0000 UTC } {PodScheduled 0 True 0001-01-01 00:00:00 +0000 UTC 2025-09-22 01:37:51 +0000 UTC }] I0922 01:38:26.344159 25 resource.go:158] csi-mockplugin-attacher-0 latest-worker2 Running [{PodReadyToStartContainers 0 True 0001-01-01 00:00:00 +0000 UTC 2025-09-22 01:37:52 +0000 UTC } {Initialized 0 True 0001-01-01 00:00:00 +0000 UTC 2025-09-22 01:37:51 +0000 UTC } {Ready 0 True 0001-01-01 00:00:00 +0000 UTC 2025-09-22 01:37:56 +0000 UTC } {ContainersReady 0 True 0001-01-01 00:00:00 +0000 UTC 2025-09-22 01:37:56 +0000 UTC } {PodScheduled 0 True 0001-01-01 00:00:00 +0000 UTC 2025-09-22 01:37:51 +0000 UTC }] I0922 01:38:26.344173 25 resource.go:161] I0922 01:38:26.344191 25 resource.go:175] csi-mockplugin-0[mutable-allocatable-mock-2145-9129].container[csi-provisioner]=Lost connection to CSI driver, exiting I0922 01:38:26.344206 25 resource.go:175] csi-mockplugin-attacher-0[mutable-allocatable-mock-2145-9129].container[csi-attacher]=Lost connection to CSI driver, exiting I0922 01:38:26.648298 25 dump.go:109] Logging node info for node latest-control-plane I0922 01:38:26.691728 25 dump.go:114] Node Info: &Node{ObjectMeta:{latest-control-plane 4a88f68e-a233-4137-96e6-a4d02b8e46e1 6003540 0 2025-08-14 10:01:12 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:latest-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2025-08-14 10:01:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2025-08-14 10:01:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2025-08-14 10:01:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2025-09-22 01:37:57 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:runtimeHandlers":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/latest/latest-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67398062080 0} {} 65818420Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67398062080 0} {} 65818420Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2025-09-22 01:37:57 +0000 UTC,LastTransitionTime:2025-08-14 10:01:10 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2025-09-22 01:37:57 +0000 UTC,LastTransitionTime:2025-08-14 10:01:10 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2025-09-22 01:37:57 +0000 UTC,LastTransitionTime:2025-08-14 10:01:10 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2025-09-22 01:37:57 +0000 UTC,LastTransitionTime:2025-08-14 10:01:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.0.13,},NodeAddress{Type:Hostname,Address:latest-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:c7fda80d8f9641588679c7e1084a869f,SystemUUID:634ef398-8dbd-484b-881c-6c5a7cef3a32,BootID:505e7ca9-c9d0-4e24-a4f5-b43989aac371,KernelVersion:5.15.0-138-generic,OSImage:Debian GNU/Linux 12 (bookworm),ContainerRuntimeVersion:containerd://2.1.1,KubeletVersion:v1.33.1,KubeProxyVersion:,OperatingSystem:linux,Architecture:amd64,Swap:&NodeSwapStatus{Capacity:*1023406080,},},Images:[]ContainerImage{ContainerImage{Names:[docker.io/sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 docker.io/sirot/netperf-latest:latest],SizeBytes:118405146,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.33.1 registry.k8s.io/kube-apiserver:v1.33.1],SizeBytes:102853105,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.33.1 registry.k8s.io/kube-proxy:v1.33.1],SizeBytes:99143369,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.33.1 registry.k8s.io/kube-controller-manager:v1.33.1],SizeBytes:95652183,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.33.1 registry.k8s.io/kube-scheduler:v1.33.1],SizeBytes:74496343,},ContainerImage{Names:[docker.io/aquasec/kube-bench@sha256:d079de1fa7f757b367c39ee12eafc0e8729e94962df2c29808f4b602a615c142 docker.io/aquasec/kube-bench:latest],SizeBytes:62003820,},ContainerImage{Names:[docker.io/aquasec/kube-bench@sha256:e68c8040406b92b9df6566bd140523da57e12d5bf0a193ba985526050ddb4e87],SizeBytes:60365666,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.21-0],SizeBytes:58938593,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20250512-df8de77b],SizeBytes:44375501,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v20250214-acbabc1a],SizeBytes:22540870,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.12.0],SizeBytes:20939036,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20241212-8ac705d0],SizeBytes:3084671,},ContainerImage{Names:[docker.io/library/alpine@sha256:66790a2b79e1ea3e1dabac43990c54aca5d1ddf268d9a5a0285e4167c8b24475 docker.io/library/alpine:3.6],SizeBytes:2021226,},ContainerImage{Names:[registry.k8s.io/pause@sha256:278fb9dbcca9518083ad1e11276933a2e96f23de604a3a08cc3c80002767d24c registry.k8s.io/pause:3.10.1],SizeBytes:320448,},ContainerImage{Names:[registry.k8s.io/pause:3.10],SizeBytes:320368,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,RuntimeHandlers:[]NodeRuntimeHandler{NodeRuntimeHandler{Name:runc,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},NodeRuntimeHandler{Name:,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},NodeRuntimeHandler{Name:test-handler,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},},Features:&NodeFeatures{SupplementalGroupsPolicy:*true,},},} I0922 01:38:26.691766 25 dump.go:116] Logging kubelet events for node latest-control-plane I0922 01:38:26.741785 25 dump.go:121] Logging pods the kubelet thinks are on node latest-control-plane I0922 01:38:26.818568 25 dump.go:128] kube-system/etcd-latest-control-plane started at 2025-08-14 10:01:15 +0000 UTC (0+1 container statuses recorded) I0922 01:38:26.818603 25 dump.go:134] Container etcd ready: true, restart count 0 I0922 01:38:26.818627 25 dump.go:128] kube-system/kube-apiserver-latest-control-plane started at 2025-08-14 10:01:15 +0000 UTC (0+1 container statuses recorded) I0922 01:38:26.818646 25 dump.go:134] Container kube-apiserver ready: true, restart count 0 I0922 01:38:26.818667 25 dump.go:128] kube-system/kube-controller-manager-latest-control-plane started at 2025-08-14 10:01:15 +0000 UTC (0+1 container statuses recorded) I0922 01:38:26.818684 25 dump.go:134] Container kube-controller-manager ready: true, restart count 0 I0922 01:38:26.818704 25 dump.go:128] kube-system/kube-scheduler-latest-control-plane started at 2025-08-14 10:01:15 +0000 UTC (0+1 container statuses recorded) I0922 01:38:26.818721 25 dump.go:134] Container kube-scheduler ready: true, restart count 0 I0922 01:38:26.818740 25 dump.go:128] kube-system/kindnet-qc9kz started at 2025-08-14 10:01:20 +0000 UTC (0+1 container statuses recorded) I0922 01:38:26.818756 25 dump.go:134] Container kindnet-cni ready: true, restart count 0 I0922 01:38:26.818775 25 dump.go:128] kube-system/coredns-674b8bbfcf-klpkw started at 2025-08-14 10:01:35 +0000 UTC (0+1 container statuses recorded) I0922 01:38:26.818792 25 dump.go:134] Container coredns ready: true, restart count 0 I0922 01:38:26.818811 25 dump.go:128] local-path-storage/local-path-provisioner-7dc846544d-kfzml started at 2025-08-14 10:01:35 +0000 UTC (0+1 container statuses recorded) I0922 01:38:26.818843 25 dump.go:134] Container local-path-provisioner ready: true, restart count 0 I0922 01:38:26.818862 25 dump.go:128] kube-system/kube-proxy-pmhrl started at 2025-08-14 10:01:20 +0000 UTC (0+1 container statuses recorded) I0922 01:38:26.818875 25 dump.go:134] Container kube-proxy ready: true, restart count 0 I0922 01:38:26.818897 25 dump.go:128] kube-system/create-loop-devs-mbrb2 started at 2025-08-14 10:01:25 +0000 UTC (0+1 container statuses recorded) I0922 01:38:26.818917 25 dump.go:134] Container loopdev ready: true, restart count 0 I0922 01:38:26.818937 25 dump.go:128] kube-system/coredns-674b8bbfcf-2h8qn started at 2025-08-14 10:01:35 +0000 UTC (0+1 container statuses recorded) I0922 01:38:26.818954 25 dump.go:134] Container coredns ready: true, restart count 0 I0922 01:38:27.000609 25 kubelet_metrics.go:206] Latency metrics for node latest-control-plane I0922 01:38:27.000649 25 dump.go:109] Logging node info for node latest-worker I0922 01:38:27.005322 25 dump.go:114] Node Info: &Node{ObjectMeta:{latest-worker 8c88dec8-b208-4951-9edb-9daf6e60cfed 6004032 0 2025-08-14 10:01:24 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:latest-worker kubernetes.io/os:linux topology.hostpath.csi/node:latest-worker] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2025-08-14 10:01:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2025-08-14 10:01:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2025-09-15 02:53:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {kubelet Update v1 2025-09-22 01:38:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:runtimeHandlers":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/latest/latest-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67398062080 0} {} 65818420Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67398062080 0} {} 65818420Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2025-09-22 01:38:20 +0000 UTC,LastTransitionTime:2025-08-14 10:01:24 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2025-09-22 01:38:20 +0000 UTC,LastTransitionTime:2025-08-14 10:01:24 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2025-09-22 01:38:20 +0000 UTC,LastTransitionTime:2025-08-14 10:01:24 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2025-09-22 01:38:20 +0000 UTC,LastTransitionTime:2025-08-14 10:01:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.0.12,},NodeAddress{Type:Hostname,Address:latest-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f7df88837db5436386878b8262a14e32,SystemUUID:7f723078-9e20-4c29-be13-6b3e065907c6,BootID:505e7ca9-c9d0-4e24-a4f5-b43989aac371,KernelVersion:5.15.0-138-generic,OSImage:Debian GNU/Linux 12 (bookworm),ContainerRuntimeVersion:containerd://2.1.1,KubeletVersion:v1.33.1,KubeProxyVersion:,OperatingSystem:linux,Architecture:amd64,Swap:&NodeSwapStatus{Capacity:*1023406080,},},Images:[]ContainerImage{ContainerImage{Names:[docker.io/lfncnti/cluster-tools@sha256:906f9b2c15b6f64d83c52bf9efd108b434d311fb548ac20abcfb815981e741b6 docker.io/lfncnti/cluster-tools:v1.0.8],SizeBytes:466650686,},ContainerImage{Names:[docker.io/ollivier/clearwater-cassandra@sha256:7460a5e29c91e16bd36534b5284b27832e1c6e0f7c22a4bb79eda79942d250e1 docker.io/ollivier/clearwater-cassandra:hunter],SizeBytes:386500834,},ContainerImage{Names:[docker.io/ollivier/clearwater-homestead-prov@sha256:ef3803b4336ea217f9a467dac7f5c4bc3d2cd0f3cbbcc6c101419506fc3a6fa4 docker.io/ollivier/clearwater-homestead-prov:hunter],SizeBytes:360721934,},ContainerImage{Names:[docker.io/ollivier/clearwater-astaire@sha256:5bc730435563dc3e31f3a3b7bb58b5899c453929b624052622b3a9a1c2fd04d8 docker.io/ollivier/clearwater-astaire:hunter],SizeBytes:327310970,},ContainerImage{Names:[docker.io/ollivier/clearwater-bono@sha256:0da41ddbf72c158f8e617015450587634cdf6856696005601b2108df92a27254 docker.io/ollivier/clearwater-bono:hunter],SizeBytes:303708624,},ContainerImage{Names:[docker.io/ollivier/clearwater-homestead@sha256:8467d6c9caefa6a402eba927ee31f8179b2dc3386ac4768dd04f4bd630a1b9e9 docker.io/ollivier/clearwater-homestead:hunter],SizeBytes:295167572,},ContainerImage{Names:[litmuschaos.docker.scarf.sh/litmuschaos/go-runner@sha256:4664e5d3eba9f9f805900045fc632dd4f35d96b9a744800c0eade4fde45de681 litmuschaos.docker.scarf.sh/litmuschaos/go-runner:3.6.0],SizeBytes:190137665,},ContainerImage{Names:[docker.io/library/docker@sha256:c0872aae4791ff427e6eda52769afa04f17b5cf756f8267e0d52774c99d5c9de docker.io/library/docker:dind],SizeBytes:145422022,},ContainerImage{Names:[docker.io/sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 docker.io/sirot/netperf-latest:latest],SizeBytes:118405146,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.33.1 registry.k8s.io/kube-apiserver:v1.33.1],SizeBytes:102853105,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.33.1 registry.k8s.io/kube-proxy:v1.33.1],SizeBytes:99143369,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.33.1 registry.k8s.io/kube-controller-manager:v1.33.1],SizeBytes:95652183,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:c825f3d5e28bde099bd7a3daace28772d412c9157ad47fa752a9ad0baafc118d registry.k8s.io/sig-storage/nfs-provisioner:v4.0.8],SizeBytes:91036984,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.33.1 registry.k8s.io/kube-scheduler:v1.33.1],SizeBytes:74496343,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:e36c081683425b5b3bc1425bc508b37e7107bb65dfa9367bf5a80125d431fa19 registry.k8s.io/etcd:3.6.4-0],SizeBytes:74311308,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.21-0],SizeBytes:58938593,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:352a050380078cb2a1c246357a0dfa2fcf243ee416b92ff28b44a01d1b4b0294 registry.k8s.io/e2e-test-images/agnhost:2.56],SizeBytes:55898458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper@sha256:60c11972feffb389c42762ab7ba596dcbfe88aed032b9c4a9cb9adedaaf8a35c docker.io/openpolicyagent/gatekeeper:v3.20.0],SizeBytes:46856023,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper@sha256:6fda2898bdbdb9d446ce71b1f6bfe0efad87076025989642b5d151c17fd9a77c docker.io/openpolicyagent/gatekeeper:v3.20.1],SizeBytes:44884438,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20250512-df8de77b],SizeBytes:44375501,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:19d4ecf1e0731b9ea55aca9c070d520f68b96ed0defbcc0e4eefe97b3d663ca3 registry.k8s.io/e2e-test-images/sample-apiserver:1.29.2],SizeBytes:39672997,},ContainerImage{Names:[docker.io/ollivier/clearwater-live-test@sha256:1ec1c46f531b5466e62e2a3f1e65e97336e8ea0ca50f11a4305775d6aeac9a58 docker.io/ollivier/clearwater-live-test:hunter],SizeBytes:39060692,},ContainerImage{Names:[docker.io/aquasec/kube-hunter@sha256:885520da54150bd9d133b30d59df645fdc5a06644809d987e1d3c707c3dd2aaf docker.io/aquasec/kube-hunter:latest],SizeBytes:38278209,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:2a0b297cc7c4cd376ac7413df339ff2fdaa1ec9d099aed92b5ea1f031ef7f639 registry.k8s.io/sig-storage/csi-resizer:v1.13.1],SizeBytes:32400950,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:a399393ff5bd156277c56bae0c08389b1a1b95b7fd6ea44a316ce55e0dd559d7 registry.k8s.io/sig-storage/csi-attacher:v4.8.0],SizeBytes:32231444,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:672e45d6a55678abc1d102de665b5cbd63848e75dc7896f238c8eaaf3c7d322f registry.k8s.io/sig-storage/csi-provisioner:v5.1.0],SizeBytes:32167411,},ContainerImage{Names:[litmuschaos.docker.scarf.sh/litmuschaos/chaos-operator@sha256:f37e85afc0412a47d1e028e5f86b6cc3a8cbbfe59369beba0af5401aa47dfd63 litmuschaos.docker.scarf.sh/litmuschaos/chaos-operator:3.6.0],SizeBytes:29032757,},ContainerImage{Names:[litmuschaos.docker.scarf.sh/litmuschaos/chaos-runner@sha256:a762f650ce60ab0698c79e4b646c941933fab46837c69a0a888addb6bda0ccb6 litmuschaos.docker.scarf.sh/litmuschaos/chaos-runner:3.6.0],SizeBytes:27151116,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v20250214-acbabc1a],SizeBytes:22540870,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.12.0],SizeBytes:20939036,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:65192845eeac8e24a708f865911776a0d8490ab886e78dad17e80ae1870e7410 registry.k8s.io/sig-storage/hostpathplugin:v1.16.1],SizeBytes:20349620,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper-crds@sha256:011fadc314224fa0dccb59b3770ae3f355c31ae512bbcbb3ca4a362c7d616622 docker.io/openpolicyagent/gatekeeper-crds:v3.20.1],SizeBytes:18120390,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper-crds@sha256:d60ccbbfb53422fd0af71486ed5171343f741e9e7ef9fa4dea86719e684d5e54 docker.io/openpolicyagent/gatekeeper-crds:v3.20.0],SizeBytes:17993290,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:f6602cc2b5a2ff2138db48546d727e72599cd14021cdc5309142f407f5d43969 quay.io/coreos/etcd:v3.2.32],SizeBytes:16250306,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:d7138bcc3aa5f267403d45ad4292c95397e421ea17a0035888850f424c7de25d registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.13.0],SizeBytes:14781503,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:2c8d61c46f484d881db43b34d13ca47a269336e576c81cf007ca740fa9ec0800 docker.io/coredns/coredns:1.6.7],SizeBytes:13598515,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:cc8fb77bc2a0541949d1d9320a641b82fd392b0d3d8145469ca4709ae769980e docker.io/coredns/coredns:1.8.0],SizeBytes:12945155,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:4a6e0769130686518325b21b0c1d0688b54e7c79244d48e1b15634e98e40c6ef docker.io/coredns/coredns:1.7.1],SizeBytes:12935701,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:9d12cad5c4a1a4c1a853947ae4cbf31a860f98bb450173fee644d8e63ce6ea4d registry.k8s.io/build-image/distroless-iptables:v0.7.7],SizeBytes:11558416,},ContainerImage{Names:[docker.io/curlimages/curl@sha256:3dfa70a646c5d03ddf0e7c0ff518a5661e95b8bcbc82079f0fb7453a96eaae35 docker.io/curlimages/curl:8.12.0],SizeBytes:10048754,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:4381769,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20241212-8ac705d0],SizeBytes:3084671,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,RuntimeHandlers:[]NodeRuntimeHandler{NodeRuntimeHandler{Name:runc,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},NodeRuntimeHandler{Name:,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},NodeRuntimeHandler{Name:test-handler,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},},Features:&NodeFeatures{SupplementalGroupsPolicy:*true,},},} I0922 01:38:27.005429 25 dump.go:116] Logging kubelet events for node latest-worker I0922 01:38:27.041221 25 dump.go:121] Logging pods the kubelet thinks are on node latest-worker I0922 01:38:27.108698 25 dump.go:128] kube-system/kube-proxy-plcq4 started at 2025-08-14 10:01:24 +0000 UTC (0+1 container statuses recorded) I0922 01:38:27.108734 25 dump.go:134] Container kube-proxy ready: true, restart count 0 I0922 01:38:27.108758 25 dump.go:128] persistent-local-volumes-test-9009/local-volume-statefulset-2 started at 2025-09-22 01:38:23 +0000 UTC (0+1 container statuses recorded) I0922 01:38:27.108777 25 dump.go:134] Container nginx ready: true, restart count 0 I0922 01:38:27.108798 25 dump.go:128] kube-system/kindnet-kcb5w started at 2025-08-14 10:01:24 +0000 UTC (0+1 container statuses recorded) I0922 01:38:27.108815 25 dump.go:134] Container kindnet-cni ready: true, restart count 0 I0922 01:38:27.108832 25 dump.go:128] kube-system/create-loop-devs-76ng2 started at 2025-08-14 10:01:25 +0000 UTC (0+1 container statuses recorded) I0922 01:38:27.108850 25 dump.go:134] Container loopdev ready: true, restart count 0 I0922 01:38:27.108869 25 dump.go:128] projected-5743/pod-secrets-709169c8-f9d3-4f9b-85b5-8f4cda0b6231 started at 2025-09-22 01:34:46 +0000 UTC (0+1 container statuses recorded) I0922 01:38:27.108886 25 dump.go:134] Container creates-volume-test ready: false, restart count 0 I0922 01:38:27.108906 25 dump.go:128] persistent-local-volumes-test-9009/local-volume-statefulset-1 started at 2025-09-22 01:38:23 +0000 UTC (0+1 container statuses recorded) I0922 01:38:27.108922 25 dump.go:134] Container nginx ready: true, restart count 0 I0922 01:38:27.108942 25 dump.go:128] persistent-local-volumes-test-9009/hostexec-latest-worker-w4fpx started at 2025-09-22 01:37:57 +0000 UTC (0+1 container statuses recorded) I0922 01:38:27.108959 25 dump.go:134] Container agnhost-container ready: true, restart count 0 I0922 01:38:27.108977 25 dump.go:128] configmap-6713/pod-configmaps-f0690e7f-1a47-4667-8bfa-d28af75ebb56 started at 2025-09-22 01:35:13 +0000 UTC (0+1 container statuses recorded) I0922 01:38:27.108991 25 dump.go:134] Container agnhost-container ready: false, restart count 0 I0922 01:38:27.109010 25 dump.go:128] persistent-local-volumes-test-9009/local-volume-statefulset-0 started at 2025-09-22 01:38:23 +0000 UTC (0+1 container statuses recorded) I0922 01:38:27.109026 25 dump.go:134] Container nginx ready: true, restart count 0 I0922 01:38:27.109044 25 dump.go:128] projected-2629/pod-secrets-d2656533-a3df-4c23-990f-3086f18cba8a started at 2025-09-22 01:36:35 +0000 UTC (0+1 container statuses recorded) I0922 01:38:27.109061 25 dump.go:134] Container creates-volume-test ready: false, restart count 0 I0922 01:38:27.109076 25 dump.go:128] projected-1016/pod-configmaps-fb25bf8a-8b94-45d8-bfd3-67f5032eb6e6 started at 2025-09-22 01:33:29 +0000 UTC (0+1 container statuses recorded) I0922 01:38:27.109092 25 dump.go:134] Container agnhost-container ready: false, restart count 0 I0922 01:38:27.861361 25 kubelet_metrics.go:206] Latency metrics for node latest-worker I0922 01:38:27.861389 25 dump.go:109] Logging node info for node latest-worker2 I0922 01:38:27.865902 25 dump.go:114] Node Info: &Node{ObjectMeta:{latest-worker2 3d1774a3-1fed-4ae4-9649-579167a82d96 6004283 0 2025-08-14 10:01:24 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:latest-worker2 kubernetes.io/os:linux topology.hostpath.csi/node:latest-worker2] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-honor-pv-reclaim-policy-8940":"latest-worker2","csi-mock-csi-mock-volumes-expansion-8098":"csi-mock-csi-mock-volumes-expansion-8098","csi-mock-csi-mock-volumes-limit-9696":"latest-worker2","csi-mock-mutable-allocatable-mock-2145":"csi-mock-mutable-allocatable-mock-2145"} kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2025-08-14 10:01:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2025-08-14 10:01:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2025-09-08 02:54:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubelet Update v1 2025-09-22 01:38:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:runtimeHandlers":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/latest/latest-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67398062080 0} {} 65818420Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67398062080 0} {} 65818420Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2025-09-22 01:38:17 +0000 UTC,LastTransitionTime:2025-08-14 10:01:24 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2025-09-22 01:38:17 +0000 UTC,LastTransitionTime:2025-08-14 10:01:24 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2025-09-22 01:38:17 +0000 UTC,LastTransitionTime:2025-08-14 10:01:24 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2025-09-22 01:38:17 +0000 UTC,LastTransitionTime:2025-08-14 10:01:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.0.11,},NodeAddress{Type:Hostname,Address:latest-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:53b074234c804259ae0ff2cba6a6f050,SystemUUID:0c517cb0-5dd6-4327-a0bd-07b70f744e34,BootID:505e7ca9-c9d0-4e24-a4f5-b43989aac371,KernelVersion:5.15.0-138-generic,OSImage:Debian GNU/Linux 12 (bookworm),ContainerRuntimeVersion:containerd://2.1.1,KubeletVersion:v1.33.1,KubeProxyVersion:,OperatingSystem:linux,Architecture:amd64,Swap:&NodeSwapStatus{Capacity:*1023406080,},},Images:[]ContainerImage{ContainerImage{Names:[docker.io/lfncnti/cluster-tools@sha256:906f9b2c15b6f64d83c52bf9efd108b434d311fb548ac20abcfb815981e741b6 docker.io/lfncnti/cluster-tools:v1.0.8],SizeBytes:466650686,},ContainerImage{Names:[docker.io/ollivier/clearwater-ellis@sha256:abcaf4a9ec74aa746f3b3949f05ee359349fce2b0b3b2deedf67164719cff5dc docker.io/ollivier/clearwater-ellis:hunter],SizeBytes:351519591,},ContainerImage{Names:[docker.io/ollivier/clearwater-homer@sha256:f8738d756137990120f6aafca7e0bc57186ab591a4b51508ba9ddf30688f4de1 docker.io/ollivier/clearwater-homer:hunter],SizeBytes:344304298,},ContainerImage{Names:[docker.io/ollivier/clearwater-sprout@sha256:fd91f90bdfbfac30288ca296962e36537f8fa311d34711904e027098227d9f49 docker.io/ollivier/clearwater-sprout:hunter],SizeBytes:298627136,},ContainerImage{Names:[docker.io/ollivier/clearwater-ralf@sha256:7054a741dbd4ea45fa4efd8138c07e21d35fbed627971559de5df2d03883e94f docker.io/ollivier/clearwater-ralf:hunter],SizeBytes:287441316,},ContainerImage{Names:[docker.io/ollivier/clearwater-chronos@sha256:1d5f9b5385db632e3076463fec5a4db5d4a15ef21ac5a112cb42fb0551ffa36d docker.io/ollivier/clearwater-chronos:hunter],SizeBytes:285504787,},ContainerImage{Names:[litmuschaos.docker.scarf.sh/litmuschaos/go-runner@sha256:4664e5d3eba9f9f805900045fc632dd4f35d96b9a744800c0eade4fde45de681 litmuschaos.docker.scarf.sh/litmuschaos/go-runner:3.6.0],SizeBytes:190137665,},ContainerImage{Names:[docker.io/library/docker@sha256:831644212c5bdd0b3362b5855c87b980ea39a83c9e9adcef2ce03eced99a737a docker.io/library/docker:dind],SizeBytes:148417865,},ContainerImage{Names:[docker.io/sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 docker.io/sirot/netperf-latest:latest],SizeBytes:118405146,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.33.1 registry.k8s.io/kube-apiserver:v1.33.1],SizeBytes:102853105,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.33.1 registry.k8s.io/kube-proxy:v1.33.1],SizeBytes:99143369,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.33.1 registry.k8s.io/kube-controller-manager:v1.33.1],SizeBytes:95652183,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:c825f3d5e28bde099bd7a3daace28772d412c9157ad47fa752a9ad0baafc118d registry.k8s.io/sig-storage/nfs-provisioner:v4.0.8],SizeBytes:91036984,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.33.1 registry.k8s.io/kube-scheduler:v1.33.1],SizeBytes:74496343,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:e36c081683425b5b3bc1425bc508b37e7107bb65dfa9367bf5a80125d431fa19 registry.k8s.io/etcd:3.6.4-0],SizeBytes:74311308,},ContainerImage{Names:[docker.io/aquasec/kube-bench@sha256:d079de1fa7f757b367c39ee12eafc0e8729e94962df2c29808f4b602a615c142 docker.io/aquasec/kube-bench:latest],SizeBytes:62003820,},ContainerImage{Names:[docker.io/aquasec/kube-bench@sha256:e68c8040406b92b9df6566bd140523da57e12d5bf0a193ba985526050ddb4e87],SizeBytes:60365666,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.21-0],SizeBytes:58938593,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:352a050380078cb2a1c246357a0dfa2fcf243ee416b92ff28b44a01d1b4b0294 registry.k8s.io/e2e-test-images/agnhost:2.56],SizeBytes:55898458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper@sha256:60c11972feffb389c42762ab7ba596dcbfe88aed032b9c4a9cb9adedaaf8a35c docker.io/openpolicyagent/gatekeeper:v3.20.0],SizeBytes:46856023,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper@sha256:6fda2898bdbdb9d446ce71b1f6bfe0efad87076025989642b5d151c17fd9a77c docker.io/openpolicyagent/gatekeeper:v3.20.1],SizeBytes:44884438,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20250512-df8de77b],SizeBytes:44375501,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:19d4ecf1e0731b9ea55aca9c070d520f68b96ed0defbcc0e4eefe97b3d663ca3 registry.k8s.io/e2e-test-images/sample-apiserver:1.29.2],SizeBytes:39672997,},ContainerImage{Names:[docker.io/ollivier/clearwater-live-test@sha256:1ec1c46f531b5466e62e2a3f1e65e97336e8ea0ca50f11a4305775d6aeac9a58 docker.io/ollivier/clearwater-live-test:hunter],SizeBytes:39060692,},ContainerImage{Names:[docker.io/aquasec/kube-hunter@sha256:885520da54150bd9d133b30d59df645fdc5a06644809d987e1d3c707c3dd2aaf docker.io/aquasec/kube-hunter:latest],SizeBytes:38278209,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:2a0b297cc7c4cd376ac7413df339ff2fdaa1ec9d099aed92b5ea1f031ef7f639 registry.k8s.io/sig-storage/csi-resizer:v1.13.1],SizeBytes:32400950,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:a399393ff5bd156277c56bae0c08389b1a1b95b7fd6ea44a316ce55e0dd559d7 registry.k8s.io/sig-storage/csi-attacher:v4.8.0],SizeBytes:32231444,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:672e45d6a55678abc1d102de665b5cbd63848e75dc7896f238c8eaaf3c7d322f registry.k8s.io/sig-storage/csi-provisioner:v5.1.0],SizeBytes:32167411,},ContainerImage{Names:[litmuschaos.docker.scarf.sh/litmuschaos/chaos-operator@sha256:f37e85afc0412a47d1e028e5f86b6cc3a8cbbfe59369beba0af5401aa47dfd63 litmuschaos.docker.scarf.sh/litmuschaos/chaos-operator:3.6.0],SizeBytes:29032757,},ContainerImage{Names:[litmuschaos.docker.scarf.sh/litmuschaos/chaos-runner@sha256:a762f650ce60ab0698c79e4b646c941933fab46837c69a0a888addb6bda0ccb6 litmuschaos.docker.scarf.sh/litmuschaos/chaos-runner:3.6.0],SizeBytes:27151116,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v20250214-acbabc1a],SizeBytes:22540870,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.12.0],SizeBytes:20939036,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:65192845eeac8e24a708f865911776a0d8490ab886e78dad17e80ae1870e7410 registry.k8s.io/sig-storage/hostpathplugin:v1.16.1],SizeBytes:20349620,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper-crds@sha256:011fadc314224fa0dccb59b3770ae3f355c31ae512bbcbb3ca4a362c7d616622 docker.io/openpolicyagent/gatekeeper-crds:v3.20.1],SizeBytes:18120390,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper-crds@sha256:d60ccbbfb53422fd0af71486ed5171343f741e9e7ef9fa4dea86719e684d5e54 docker.io/openpolicyagent/gatekeeper-crds:v3.20.0],SizeBytes:17993290,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:f6602cc2b5a2ff2138db48546d727e72599cd14021cdc5309142f407f5d43969 quay.io/coreos/etcd:v3.2.32],SizeBytes:16250306,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:d7138bcc3aa5f267403d45ad4292c95397e421ea17a0035888850f424c7de25d registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.13.0],SizeBytes:14781503,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:2c8d61c46f484d881db43b34d13ca47a269336e576c81cf007ca740fa9ec0800 docker.io/coredns/coredns:1.6.7],SizeBytes:13598515,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:cc8fb77bc2a0541949d1d9320a641b82fd392b0d3d8145469ca4709ae769980e docker.io/coredns/coredns:1.8.0],SizeBytes:12945155,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:4a6e0769130686518325b21b0c1d0688b54e7c79244d48e1b15634e98e40c6ef docker.io/coredns/coredns:1.7.1],SizeBytes:12935701,},ContainerImage{Names:[docker.io/curlimages/curl@sha256:3dfa70a646c5d03ddf0e7c0ff518a5661e95b8bcbc82079f0fb7453a96eaae35 docker.io/curlimages/curl:8.12.0],SizeBytes:10048754,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:4381769,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,RuntimeHandlers:[]NodeRuntimeHandler{NodeRuntimeHandler{Name:test-handler,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},NodeRuntimeHandler{Name:runc,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},NodeRuntimeHandler{Name:,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},},Features:&NodeFeatures{SupplementalGroupsPolicy:*true,},},} I0922 01:38:27.865953 25 dump.go:116] Logging kubelet events for node latest-worker2 I0922 01:38:27.868250 25 dump.go:121] Logging pods the kubelet thinks are on node latest-worker2 I0922 01:38:27.885073 25 dump.go:128] csi-mock-volumes-expansion-8098-2538/csi-mockplugin-resizer-0 started at 2025-09-22 01:38:23 +0000 UTC (0+1 container statuses recorded) I0922 01:38:27.885106 25 dump.go:134] Container csi-resizer ready: false, restart count 0 I0922 01:38:27.885127 25 dump.go:128] kube-system/kindnet-pthkx started at 2025-08-14 10:01:24 +0000 UTC (0+1 container statuses recorded) I0922 01:38:27.885145 25 dump.go:134] Container kindnet-cni ready: true, restart count 0 I0922 01:38:27.885165 25 dump.go:128] persistent-local-volumes-test-9009/hostexec-latest-worker2-4tbdn started at 2025-09-22 01:38:10 +0000 UTC (0+1 container statuses recorded) I0922 01:38:27.885182 25 dump.go:134] Container agnhost-container ready: true, restart count 0 I0922 01:38:27.885201 25 dump.go:128] csi-mock-volumes-expansion-8098-2538/csi-mockplugin-0 started at 2025-09-22 01:38:23 +0000 UTC (0+4 container statuses recorded) I0922 01:38:27.885218 25 dump.go:134] Container busybox ready: true, restart count 0 I0922 01:38:27.885235 25 dump.go:134] Container csi-provisioner ready: false, restart count 0 I0922 01:38:27.885252 25 dump.go:134] Container driver-registrar ready: true, restart count 0 I0922 01:38:27.885268 25 dump.go:134] Container mock ready: true, restart count 0 I0922 01:38:27.885286 25 dump.go:128] kube-system/kube-proxy-splj6 started at 2025-08-14 10:01:24 +0000 UTC (0+1 container statuses recorded) I0922 01:38:27.885302 25 dump.go:134] Container kube-proxy ready: true, restart count 0 I0922 01:38:27.885321 25 dump.go:128] csi-mock-honor-pv-reclaim-policy-8940-9230/csi-mockplugin-attacher-0 started at 2025-09-22 01:37:28 +0000 UTC (0+1 container statuses recorded) I0922 01:38:27.885340 25 dump.go:134] Container csi-attacher ready: true, restart count 0 I0922 01:38:27.885359 25 dump.go:128] csi-mock-honor-pv-reclaim-policy-8940-9230/csi-mockplugin-0 started at 2025-09-22 01:37:28 +0000 UTC (0+3 container statuses recorded) I0922 01:38:27.885378 25 dump.go:134] Container csi-provisioner ready: true, restart count 0 I0922 01:38:27.885394 25 dump.go:134] Container driver-registrar ready: true, restart count 0 I0922 01:38:27.885411 25 dump.go:134] Container mock ready: true, restart count 0 I0922 01:38:27.885431 25 dump.go:128] csi-mock-volumes-limit-9696-1977/csi-mockplugin-0 started at 2025-09-22 01:37:32 +0000 UTC (0+3 container statuses recorded) I0922 01:38:27.885447 25 dump.go:134] Container csi-provisioner ready: true, restart count 0 I0922 01:38:27.885461 25 dump.go:134] Container driver-registrar ready: true, restart count 0 I0922 01:38:27.885477 25 dump.go:134] Container mock ready: true, restart count 0 I0922 01:38:27.885496 25 dump.go:128] mutable-allocatable-mock-2145-9129/csi-mockplugin-attacher-0 started at 2025-09-22 01:37:51 +0000 UTC (0+1 container statuses recorded) I0922 01:38:27.885509 25 dump.go:134] Container csi-attacher ready: true, restart count 1 I0922 01:38:27.885527 25 dump.go:128] mutable-allocatable-mock-2145-9129/csi-mockplugin-0 started at 2025-09-22 01:37:51 +0000 UTC (0+4 container statuses recorded) I0922 01:38:27.885543 25 dump.go:134] Container busybox ready: true, restart count 0 I0922 01:38:27.885560 25 dump.go:134] Container csi-provisioner ready: true, restart count 1 I0922 01:38:27.885575 25 dump.go:134] Container driver-registrar ready: true, restart count 0 I0922 01:38:27.885591 25 dump.go:134] Container mock ready: true, restart count 0 I0922 01:38:27.885609 25 dump.go:128] kube-system/create-loop-devs-pw6dk started at 2025-08-14 10:01:25 +0000 UTC (0+1 container statuses recorded) I0922 01:38:27.885622 25 dump.go:134] Container loopdev ready: true, restart count 0 I0922 01:38:27.885640 25 dump.go:128] persistent-local-volumes-test-9006/hostexec-latest-worker2-v2gs7 started at 2025-09-22 01:38:08 +0000 UTC (0+1 container statuses recorded) I0922 01:38:27.885653 25 dump.go:134] Container agnhost-container ready: true, restart count 0 I0922 01:38:27.885671 25 dump.go:128] csi-mock-volumes-limit-9696-1977/csi-mockplugin-attacher-0 started at 2025-09-22 01:37:32 +0000 UTC (0+1 container statuses recorded) I0922 01:38:27.885688 25 dump.go:134] Container csi-attacher ready: true, restart count 0 I0922 01:38:28.744771 25 kubelet_metrics.go:206] Latency metrics for node latest-worker2 STEP: Waiting for namespaces [mutable-allocatable-mock-2145-9129] to vanish @ 09/22/25 01:38:28.75 I0922 01:39:12.898899 25 helper.go:125] Waiting up to 7m0s for all (but 0) nodes to be ready STEP: dump namespace information after failure @ 09/22/25 01:39:12.903 STEP: Collecting events from namespace "mutable-allocatable-mock-2145". @ 09/22/25 01:39:12.903 STEP: Found 0 events. @ 09/22/25 01:39:12.906 I0922 01:39:12.927412 25 resource.go:151] POD NODE PHASE GRACE CONDITIONS I0922 01:39:12.927450 25 resource.go:161] I0922 01:39:12.931226 25 dump.go:109] Logging node info for node latest-control-plane I0922 01:39:12.934856 25 dump.go:114] Node Info: &Node{ObjectMeta:{latest-control-plane 4a88f68e-a233-4137-96e6-a4d02b8e46e1 6005734 0 2025-08-14 10:01:12 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:latest-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2025-08-14 10:01:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2025-08-14 10:01:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2025-08-14 10:01:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2025-09-22 01:39:09 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:runtimeHandlers":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/latest/latest-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67398062080 0} {} 65818420Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67398062080 0} {} 65818420Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2025-09-22 01:39:09 +0000 UTC,LastTransitionTime:2025-08-14 10:01:10 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2025-09-22 01:39:09 +0000 UTC,LastTransitionTime:2025-08-14 10:01:10 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2025-09-22 01:39:09 +0000 UTC,LastTransitionTime:2025-08-14 10:01:10 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2025-09-22 01:39:09 +0000 UTC,LastTransitionTime:2025-08-14 10:01:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.0.13,},NodeAddress{Type:Hostname,Address:latest-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:c7fda80d8f9641588679c7e1084a869f,SystemUUID:634ef398-8dbd-484b-881c-6c5a7cef3a32,BootID:505e7ca9-c9d0-4e24-a4f5-b43989aac371,KernelVersion:5.15.0-138-generic,OSImage:Debian GNU/Linux 12 (bookworm),ContainerRuntimeVersion:containerd://2.1.1,KubeletVersion:v1.33.1,KubeProxyVersion:,OperatingSystem:linux,Architecture:amd64,Swap:&NodeSwapStatus{Capacity:*1023406080,},},Images:[]ContainerImage{ContainerImage{Names:[docker.io/sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 docker.io/sirot/netperf-latest:latest],SizeBytes:118405146,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.33.1 registry.k8s.io/kube-apiserver:v1.33.1],SizeBytes:102853105,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.33.1 registry.k8s.io/kube-proxy:v1.33.1],SizeBytes:99143369,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.33.1 registry.k8s.io/kube-controller-manager:v1.33.1],SizeBytes:95652183,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.33.1 registry.k8s.io/kube-scheduler:v1.33.1],SizeBytes:74496343,},ContainerImage{Names:[docker.io/aquasec/kube-bench@sha256:d079de1fa7f757b367c39ee12eafc0e8729e94962df2c29808f4b602a615c142 docker.io/aquasec/kube-bench:latest],SizeBytes:62003820,},ContainerImage{Names:[docker.io/aquasec/kube-bench@sha256:e68c8040406b92b9df6566bd140523da57e12d5bf0a193ba985526050ddb4e87],SizeBytes:60365666,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.21-0],SizeBytes:58938593,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20250512-df8de77b],SizeBytes:44375501,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v20250214-acbabc1a],SizeBytes:22540870,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.12.0],SizeBytes:20939036,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20241212-8ac705d0],SizeBytes:3084671,},ContainerImage{Names:[docker.io/library/alpine@sha256:66790a2b79e1ea3e1dabac43990c54aca5d1ddf268d9a5a0285e4167c8b24475 docker.io/library/alpine:3.6],SizeBytes:2021226,},ContainerImage{Names:[registry.k8s.io/pause@sha256:278fb9dbcca9518083ad1e11276933a2e96f23de604a3a08cc3c80002767d24c registry.k8s.io/pause:3.10.1],SizeBytes:320448,},ContainerImage{Names:[registry.k8s.io/pause:3.10],SizeBytes:320368,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,RuntimeHandlers:[]NodeRuntimeHandler{NodeRuntimeHandler{Name:,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},NodeRuntimeHandler{Name:test-handler,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},NodeRuntimeHandler{Name:runc,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},},Features:&NodeFeatures{SupplementalGroupsPolicy:*true,},},} I0922 01:39:12.934895 25 dump.go:116] Logging kubelet events for node latest-control-plane I0922 01:39:12.938020 25 dump.go:121] Logging pods the kubelet thinks are on node latest-control-plane I0922 01:39:12.952609 25 dump.go:128] kube-system/coredns-674b8bbfcf-2h8qn started at 2025-08-14 10:01:35 +0000 UTC (0+1 container statuses recorded) I0922 01:39:12.952645 25 dump.go:134] Container coredns ready: true, restart count 0 I0922 01:39:12.952670 25 dump.go:128] kube-system/etcd-latest-control-plane started at 2025-08-14 10:01:15 +0000 UTC (0+1 container statuses recorded) I0922 01:39:12.952689 25 dump.go:134] Container etcd ready: true, restart count 0 I0922 01:39:12.952710 25 dump.go:128] kube-system/kube-apiserver-latest-control-plane started at 2025-08-14 10:01:15 +0000 UTC (0+1 container statuses recorded) I0922 01:39:12.952729 25 dump.go:134] Container kube-apiserver ready: true, restart count 0 I0922 01:39:12.952750 25 dump.go:128] kube-system/kube-controller-manager-latest-control-plane started at 2025-08-14 10:01:15 +0000 UTC (0+1 container statuses recorded) I0922 01:39:12.952768 25 dump.go:134] Container kube-controller-manager ready: true, restart count 0 I0922 01:39:12.952787 25 dump.go:128] kube-system/kube-scheduler-latest-control-plane started at 2025-08-14 10:01:15 +0000 UTC (0+1 container statuses recorded) I0922 01:39:12.952806 25 dump.go:134] Container kube-scheduler ready: true, restart count 0 I0922 01:39:12.952825 25 dump.go:128] kube-system/kindnet-qc9kz started at 2025-08-14 10:01:20 +0000 UTC (0+1 container statuses recorded) I0922 01:39:12.952843 25 dump.go:134] Container kindnet-cni ready: true, restart count 0 I0922 01:39:12.952863 25 dump.go:128] kube-system/coredns-674b8bbfcf-klpkw started at 2025-08-14 10:01:35 +0000 UTC (0+1 container statuses recorded) I0922 01:39:12.952880 25 dump.go:134] Container coredns ready: true, restart count 0 I0922 01:39:12.952899 25 dump.go:128] local-path-storage/local-path-provisioner-7dc846544d-kfzml started at 2025-08-14 10:01:35 +0000 UTC (0+1 container statuses recorded) I0922 01:39:12.952916 25 dump.go:134] Container local-path-provisioner ready: true, restart count 0 I0922 01:39:12.952936 25 dump.go:128] kube-system/kube-proxy-pmhrl started at 2025-08-14 10:01:20 +0000 UTC (0+1 container statuses recorded) I0922 01:39:12.952952 25 dump.go:134] Container kube-proxy ready: true, restart count 0 I0922 01:39:12.952971 25 dump.go:128] kube-system/create-loop-devs-mbrb2 started at 2025-08-14 10:01:25 +0000 UTC (0+1 container statuses recorded) I0922 01:39:12.952987 25 dump.go:134] Container loopdev ready: true, restart count 0 I0922 01:39:13.087343 25 kubelet_metrics.go:206] Latency metrics for node latest-control-plane I0922 01:39:13.087385 25 dump.go:109] Logging node info for node latest-worker I0922 01:39:13.091593 25 dump.go:114] Node Info: &Node{ObjectMeta:{latest-worker 8c88dec8-b208-4951-9edb-9daf6e60cfed 6005737 0 2025-08-14 10:01:24 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:latest-worker kubernetes.io/os:linux topology.hostpath.csi/node:latest-worker] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-capacity-259":"latest-worker"} kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2025-08-14 10:01:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2025-08-14 10:01:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2025-09-15 02:53:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {kubelet Update v1 2025-09-22 01:39:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:runtimeHandlers":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/latest/latest-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67398062080 0} {} 65818420Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67398062080 0} {} 65818420Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2025-09-22 01:39:01 +0000 UTC,LastTransitionTime:2025-08-14 10:01:24 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2025-09-22 01:39:01 +0000 UTC,LastTransitionTime:2025-08-14 10:01:24 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2025-09-22 01:39:01 +0000 UTC,LastTransitionTime:2025-08-14 10:01:24 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2025-09-22 01:39:01 +0000 UTC,LastTransitionTime:2025-08-14 10:01:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.0.12,},NodeAddress{Type:Hostname,Address:latest-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f7df88837db5436386878b8262a14e32,SystemUUID:7f723078-9e20-4c29-be13-6b3e065907c6,BootID:505e7ca9-c9d0-4e24-a4f5-b43989aac371,KernelVersion:5.15.0-138-generic,OSImage:Debian GNU/Linux 12 (bookworm),ContainerRuntimeVersion:containerd://2.1.1,KubeletVersion:v1.33.1,KubeProxyVersion:,OperatingSystem:linux,Architecture:amd64,Swap:&NodeSwapStatus{Capacity:*1023406080,},},Images:[]ContainerImage{ContainerImage{Names:[docker.io/lfncnti/cluster-tools@sha256:906f9b2c15b6f64d83c52bf9efd108b434d311fb548ac20abcfb815981e741b6 docker.io/lfncnti/cluster-tools:v1.0.8],SizeBytes:466650686,},ContainerImage{Names:[docker.io/ollivier/clearwater-cassandra@sha256:7460a5e29c91e16bd36534b5284b27832e1c6e0f7c22a4bb79eda79942d250e1 docker.io/ollivier/clearwater-cassandra:hunter],SizeBytes:386500834,},ContainerImage{Names:[docker.io/ollivier/clearwater-homestead-prov@sha256:ef3803b4336ea217f9a467dac7f5c4bc3d2cd0f3cbbcc6c101419506fc3a6fa4 docker.io/ollivier/clearwater-homestead-prov:hunter],SizeBytes:360721934,},ContainerImage{Names:[docker.io/ollivier/clearwater-astaire@sha256:5bc730435563dc3e31f3a3b7bb58b5899c453929b624052622b3a9a1c2fd04d8 docker.io/ollivier/clearwater-astaire:hunter],SizeBytes:327310970,},ContainerImage{Names:[docker.io/ollivier/clearwater-bono@sha256:0da41ddbf72c158f8e617015450587634cdf6856696005601b2108df92a27254 docker.io/ollivier/clearwater-bono:hunter],SizeBytes:303708624,},ContainerImage{Names:[docker.io/ollivier/clearwater-homestead@sha256:8467d6c9caefa6a402eba927ee31f8179b2dc3386ac4768dd04f4bd630a1b9e9 docker.io/ollivier/clearwater-homestead:hunter],SizeBytes:295167572,},ContainerImage{Names:[litmuschaos.docker.scarf.sh/litmuschaos/go-runner@sha256:4664e5d3eba9f9f805900045fc632dd4f35d96b9a744800c0eade4fde45de681 litmuschaos.docker.scarf.sh/litmuschaos/go-runner:3.6.0],SizeBytes:190137665,},ContainerImage{Names:[docker.io/library/docker@sha256:c0872aae4791ff427e6eda52769afa04f17b5cf756f8267e0d52774c99d5c9de docker.io/library/docker:dind],SizeBytes:145422022,},ContainerImage{Names:[docker.io/sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 docker.io/sirot/netperf-latest:latest],SizeBytes:118405146,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.33.1 registry.k8s.io/kube-apiserver:v1.33.1],SizeBytes:102853105,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.33.1 registry.k8s.io/kube-proxy:v1.33.1],SizeBytes:99143369,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.33.1 registry.k8s.io/kube-controller-manager:v1.33.1],SizeBytes:95652183,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:c825f3d5e28bde099bd7a3daace28772d412c9157ad47fa752a9ad0baafc118d registry.k8s.io/sig-storage/nfs-provisioner:v4.0.8],SizeBytes:91036984,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.33.1 registry.k8s.io/kube-scheduler:v1.33.1],SizeBytes:74496343,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:e36c081683425b5b3bc1425bc508b37e7107bb65dfa9367bf5a80125d431fa19 registry.k8s.io/etcd:3.6.4-0],SizeBytes:74311308,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.21-0],SizeBytes:58938593,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:352a050380078cb2a1c246357a0dfa2fcf243ee416b92ff28b44a01d1b4b0294 registry.k8s.io/e2e-test-images/agnhost:2.56],SizeBytes:55898458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper@sha256:60c11972feffb389c42762ab7ba596dcbfe88aed032b9c4a9cb9adedaaf8a35c docker.io/openpolicyagent/gatekeeper:v3.20.0],SizeBytes:46856023,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper@sha256:6fda2898bdbdb9d446ce71b1f6bfe0efad87076025989642b5d151c17fd9a77c docker.io/openpolicyagent/gatekeeper:v3.20.1],SizeBytes:44884438,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20250512-df8de77b],SizeBytes:44375501,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:19d4ecf1e0731b9ea55aca9c070d520f68b96ed0defbcc0e4eefe97b3d663ca3 registry.k8s.io/e2e-test-images/sample-apiserver:1.29.2],SizeBytes:39672997,},ContainerImage{Names:[docker.io/ollivier/clearwater-live-test@sha256:1ec1c46f531b5466e62e2a3f1e65e97336e8ea0ca50f11a4305775d6aeac9a58 docker.io/ollivier/clearwater-live-test:hunter],SizeBytes:39060692,},ContainerImage{Names:[docker.io/aquasec/kube-hunter@sha256:885520da54150bd9d133b30d59df645fdc5a06644809d987e1d3c707c3dd2aaf docker.io/aquasec/kube-hunter:latest],SizeBytes:38278209,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:2a0b297cc7c4cd376ac7413df339ff2fdaa1ec9d099aed92b5ea1f031ef7f639 registry.k8s.io/sig-storage/csi-resizer:v1.13.1],SizeBytes:32400950,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:a399393ff5bd156277c56bae0c08389b1a1b95b7fd6ea44a316ce55e0dd559d7 registry.k8s.io/sig-storage/csi-attacher:v4.8.0],SizeBytes:32231444,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:672e45d6a55678abc1d102de665b5cbd63848e75dc7896f238c8eaaf3c7d322f registry.k8s.io/sig-storage/csi-provisioner:v5.1.0],SizeBytes:32167411,},ContainerImage{Names:[litmuschaos.docker.scarf.sh/litmuschaos/chaos-operator@sha256:f37e85afc0412a47d1e028e5f86b6cc3a8cbbfe59369beba0af5401aa47dfd63 litmuschaos.docker.scarf.sh/litmuschaos/chaos-operator:3.6.0],SizeBytes:29032757,},ContainerImage{Names:[litmuschaos.docker.scarf.sh/litmuschaos/chaos-runner@sha256:a762f650ce60ab0698c79e4b646c941933fab46837c69a0a888addb6bda0ccb6 litmuschaos.docker.scarf.sh/litmuschaos/chaos-runner:3.6.0],SizeBytes:27151116,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v20250214-acbabc1a],SizeBytes:22540870,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.12.0],SizeBytes:20939036,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:65192845eeac8e24a708f865911776a0d8490ab886e78dad17e80ae1870e7410 registry.k8s.io/sig-storage/hostpathplugin:v1.16.1],SizeBytes:20349620,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper-crds@sha256:011fadc314224fa0dccb59b3770ae3f355c31ae512bbcbb3ca4a362c7d616622 docker.io/openpolicyagent/gatekeeper-crds:v3.20.1],SizeBytes:18120390,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper-crds@sha256:d60ccbbfb53422fd0af71486ed5171343f741e9e7ef9fa4dea86719e684d5e54 docker.io/openpolicyagent/gatekeeper-crds:v3.20.0],SizeBytes:17993290,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:f6602cc2b5a2ff2138db48546d727e72599cd14021cdc5309142f407f5d43969 quay.io/coreos/etcd:v3.2.32],SizeBytes:16250306,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:d7138bcc3aa5f267403d45ad4292c95397e421ea17a0035888850f424c7de25d registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.13.0],SizeBytes:14781503,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:2c8d61c46f484d881db43b34d13ca47a269336e576c81cf007ca740fa9ec0800 docker.io/coredns/coredns:1.6.7],SizeBytes:13598515,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:cc8fb77bc2a0541949d1d9320a641b82fd392b0d3d8145469ca4709ae769980e docker.io/coredns/coredns:1.8.0],SizeBytes:12945155,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:4a6e0769130686518325b21b0c1d0688b54e7c79244d48e1b15634e98e40c6ef docker.io/coredns/coredns:1.7.1],SizeBytes:12935701,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:9d12cad5c4a1a4c1a853947ae4cbf31a860f98bb450173fee644d8e63ce6ea4d registry.k8s.io/build-image/distroless-iptables:v0.7.7],SizeBytes:11558416,},ContainerImage{Names:[docker.io/curlimages/curl@sha256:3dfa70a646c5d03ddf0e7c0ff518a5661e95b8bcbc82079f0fb7453a96eaae35 docker.io/curlimages/curl:8.12.0],SizeBytes:10048754,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:4381769,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20241212-8ac705d0],SizeBytes:3084671,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,RuntimeHandlers:[]NodeRuntimeHandler{NodeRuntimeHandler{Name:,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},NodeRuntimeHandler{Name:test-handler,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},NodeRuntimeHandler{Name:runc,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},},Features:&NodeFeatures{SupplementalGroupsPolicy:*true,},},} I0922 01:39:13.091641 25 dump.go:116] Logging kubelet events for node latest-worker I0922 01:39:13.094663 25 dump.go:121] Logging pods the kubelet thinks are on node latest-worker I0922 01:39:13.109179 25 dump.go:128] host-path-type-file-2928/test-hostpath-type-6tv4x started at 2025-09-22 01:39:02 +0000 UTC (0+1 container statuses recorded) I0922 01:39:13.109217 25 dump.go:134] Container host-path-testing ready: true, restart count 0 I0922 01:39:13.109242 25 dump.go:128] csi-mock-volumes-capacity-259-8962/csi-mockplugin-0 started at 2025-09-22 01:39:08 +0000 UTC (0+3 container statuses recorded) I0922 01:39:13.109262 25 dump.go:134] Container csi-provisioner ready: true, restart count 0 I0922 01:39:13.109282 25 dump.go:134] Container driver-registrar ready: true, restart count 0 I0922 01:39:13.109301 25 dump.go:134] Container mock ready: true, restart count 0 I0922 01:39:13.109323 25 dump.go:128] projected-2629/pod-secrets-d2656533-a3df-4c23-990f-3086f18cba8a started at 2025-09-22 01:36:35 +0000 UTC (0+1 container statuses recorded) I0922 01:39:13.109342 25 dump.go:134] Container creates-volume-test ready: false, restart count 0 I0922 01:39:13.109363 25 dump.go:128] kube-system/kube-proxy-plcq4 started at 2025-08-14 10:01:24 +0000 UTC (0+1 container statuses recorded) I0922 01:39:13.109382 25 dump.go:134] Container kube-proxy ready: true, restart count 0 I0922 01:39:13.109401 25 dump.go:128] kube-system/kindnet-kcb5w started at 2025-08-14 10:01:24 +0000 UTC (0+1 container statuses recorded) I0922 01:39:13.109417 25 dump.go:134] Container kindnet-cni ready: true, restart count 0 I0922 01:39:13.109439 25 dump.go:128] csi-mock-volumes-node-stage-3674-6327/csi-mockplugin-0 started at 2025-09-22 01:38:30 +0000 UTC (0+4 container statuses recorded) I0922 01:39:13.109458 25 dump.go:134] Container busybox ready: true, restart count 0 I0922 01:39:13.109477 25 dump.go:134] Container csi-provisioner ready: true, restart count 1 I0922 01:39:13.109498 25 dump.go:134] Container driver-registrar ready: true, restart count 0 I0922 01:39:13.109517 25 dump.go:134] Container mock ready: true, restart count 0 I0922 01:39:13.109539 25 dump.go:128] kube-system/create-loop-devs-76ng2 started at 2025-08-14 10:01:25 +0000 UTC (0+1 container statuses recorded) I0922 01:39:13.109557 25 dump.go:134] Container loopdev ready: true, restart count 0 I0922 01:39:13.109578 25 dump.go:128] projected-5743/pod-secrets-709169c8-f9d3-4f9b-85b5-8f4cda0b6231 started at 2025-09-22 01:34:46 +0000 UTC (0+1 container statuses recorded) I0922 01:39:13.109597 25 dump.go:134] Container creates-volume-test ready: false, restart count 0 I0922 01:39:13.109615 25 dump.go:128] csi-mock-volumes-capacity-259-8962/csi-mockplugin-attacher-0 started at 2025-09-22 01:39:08 +0000 UTC (0+1 container statuses recorded) I0922 01:39:13.109634 25 dump.go:134] Container csi-attacher ready: true, restart count 0 I0922 01:39:13.109655 25 dump.go:128] configmap-6713/pod-configmaps-f0690e7f-1a47-4667-8bfa-d28af75ebb56 started at 2025-09-22 01:35:13 +0000 UTC (0+1 container statuses recorded) I0922 01:39:13.109674 25 dump.go:134] Container agnhost-container ready: false, restart count 0 I0922 01:39:13.869184 25 kubelet_metrics.go:206] Latency metrics for node latest-worker I0922 01:39:13.869216 25 dump.go:109] Logging node info for node latest-worker2 I0922 01:39:13.875672 25 dump.go:114] Node Info: &Node{ObjectMeta:{latest-worker2 3d1774a3-1fed-4ae4-9649-579167a82d96 6005717 0 2025-08-14 10:01:24 +0000 UTC map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:latest-worker2 kubernetes.io/os:linux topology.hostpath.csi/node:latest-worker2] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-expansion-2755":"csi-mock-csi-mock-volumes-expansion-2755","csi-mock-csi-mock-volumes-expansion-7967":"latest-worker2"} kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2025-08-14 10:01:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2025-08-14 10:01:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2025-09-08 02:54:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kube-controller-manager Update v1 2025-09-22 01:39:06 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2025-09-22 01:39:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:runtimeHandlers":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/latest/latest-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67398062080 0} {} 65818420Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{88 0} {} 88 DecimalSI},ephemeral-storage: {{470559055872 0} {} BinarySI},hugepages-1Gi: {{0 0} {} 0 DecimalSI},hugepages-2Mi: {{0 0} {} 0 DecimalSI},memory: {{67398062080 0} {} 65818420Ki BinarySI},pods: {{110 0} {} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2025-09-22 01:39:08 +0000 UTC,LastTransitionTime:2025-08-14 10:01:24 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2025-09-22 01:39:08 +0000 UTC,LastTransitionTime:2025-08-14 10:01:24 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2025-09-22 01:39:08 +0000 UTC,LastTransitionTime:2025-08-14 10:01:24 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2025-09-22 01:39:08 +0000 UTC,LastTransitionTime:2025-08-14 10:01:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.0.11,},NodeAddress{Type:Hostname,Address:latest-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:53b074234c804259ae0ff2cba6a6f050,SystemUUID:0c517cb0-5dd6-4327-a0bd-07b70f744e34,BootID:505e7ca9-c9d0-4e24-a4f5-b43989aac371,KernelVersion:5.15.0-138-generic,OSImage:Debian GNU/Linux 12 (bookworm),ContainerRuntimeVersion:containerd://2.1.1,KubeletVersion:v1.33.1,KubeProxyVersion:,OperatingSystem:linux,Architecture:amd64,Swap:&NodeSwapStatus{Capacity:*1023406080,},},Images:[]ContainerImage{ContainerImage{Names:[docker.io/lfncnti/cluster-tools@sha256:906f9b2c15b6f64d83c52bf9efd108b434d311fb548ac20abcfb815981e741b6 docker.io/lfncnti/cluster-tools:v1.0.8],SizeBytes:466650686,},ContainerImage{Names:[docker.io/ollivier/clearwater-ellis@sha256:abcaf4a9ec74aa746f3b3949f05ee359349fce2b0b3b2deedf67164719cff5dc docker.io/ollivier/clearwater-ellis:hunter],SizeBytes:351519591,},ContainerImage{Names:[docker.io/ollivier/clearwater-homer@sha256:f8738d756137990120f6aafca7e0bc57186ab591a4b51508ba9ddf30688f4de1 docker.io/ollivier/clearwater-homer:hunter],SizeBytes:344304298,},ContainerImage{Names:[docker.io/ollivier/clearwater-sprout@sha256:fd91f90bdfbfac30288ca296962e36537f8fa311d34711904e027098227d9f49 docker.io/ollivier/clearwater-sprout:hunter],SizeBytes:298627136,},ContainerImage{Names:[docker.io/ollivier/clearwater-ralf@sha256:7054a741dbd4ea45fa4efd8138c07e21d35fbed627971559de5df2d03883e94f docker.io/ollivier/clearwater-ralf:hunter],SizeBytes:287441316,},ContainerImage{Names:[docker.io/ollivier/clearwater-chronos@sha256:1d5f9b5385db632e3076463fec5a4db5d4a15ef21ac5a112cb42fb0551ffa36d docker.io/ollivier/clearwater-chronos:hunter],SizeBytes:285504787,},ContainerImage{Names:[litmuschaos.docker.scarf.sh/litmuschaos/go-runner@sha256:4664e5d3eba9f9f805900045fc632dd4f35d96b9a744800c0eade4fde45de681 litmuschaos.docker.scarf.sh/litmuschaos/go-runner:3.6.0],SizeBytes:190137665,},ContainerImage{Names:[docker.io/library/docker@sha256:831644212c5bdd0b3362b5855c87b980ea39a83c9e9adcef2ce03eced99a737a docker.io/library/docker:dind],SizeBytes:148417865,},ContainerImage{Names:[docker.io/sirot/netperf-latest@sha256:23929b922bb077cb341450fc1c90ae42e6f75da5d7ce61cd1880b08560a5ff85 docker.io/sirot/netperf-latest:latest],SizeBytes:118405146,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.33.1 registry.k8s.io/kube-apiserver:v1.33.1],SizeBytes:102853105,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.33.1 registry.k8s.io/kube-proxy:v1.33.1],SizeBytes:99143369,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.33.1 registry.k8s.io/kube-controller-manager:v1.33.1],SizeBytes:95652183,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:c825f3d5e28bde099bd7a3daace28772d412c9157ad47fa752a9ad0baafc118d registry.k8s.io/sig-storage/nfs-provisioner:v4.0.8],SizeBytes:91036984,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.33.1 registry.k8s.io/kube-scheduler:v1.33.1],SizeBytes:74496343,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:e36c081683425b5b3bc1425bc508b37e7107bb65dfa9367bf5a80125d431fa19 registry.k8s.io/etcd:3.6.4-0],SizeBytes:74311308,},ContainerImage{Names:[docker.io/aquasec/kube-bench@sha256:d079de1fa7f757b367c39ee12eafc0e8729e94962df2c29808f4b602a615c142 docker.io/aquasec/kube-bench:latest],SizeBytes:62003820,},ContainerImage{Names:[docker.io/aquasec/kube-bench@sha256:e68c8040406b92b9df6566bd140523da57e12d5bf0a193ba985526050ddb4e87],SizeBytes:60365666,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.21-0],SizeBytes:58938593,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:352a050380078cb2a1c246357a0dfa2fcf243ee416b92ff28b44a01d1b4b0294 registry.k8s.io/e2e-test-images/agnhost:2.56],SizeBytes:55898458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper@sha256:60c11972feffb389c42762ab7ba596dcbfe88aed032b9c4a9cb9adedaaf8a35c docker.io/openpolicyagent/gatekeeper:v3.20.0],SizeBytes:46856023,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper@sha256:6fda2898bdbdb9d446ce71b1f6bfe0efad87076025989642b5d151c17fd9a77c docker.io/openpolicyagent/gatekeeper:v3.20.1],SizeBytes:44884438,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20250512-df8de77b],SizeBytes:44375501,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:19d4ecf1e0731b9ea55aca9c070d520f68b96ed0defbcc0e4eefe97b3d663ca3 registry.k8s.io/e2e-test-images/sample-apiserver:1.29.2],SizeBytes:39672997,},ContainerImage{Names:[docker.io/ollivier/clearwater-live-test@sha256:1ec1c46f531b5466e62e2a3f1e65e97336e8ea0ca50f11a4305775d6aeac9a58 docker.io/ollivier/clearwater-live-test:hunter],SizeBytes:39060692,},ContainerImage{Names:[docker.io/aquasec/kube-hunter@sha256:885520da54150bd9d133b30d59df645fdc5a06644809d987e1d3c707c3dd2aaf docker.io/aquasec/kube-hunter:latest],SizeBytes:38278209,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:2a0b297cc7c4cd376ac7413df339ff2fdaa1ec9d099aed92b5ea1f031ef7f639 registry.k8s.io/sig-storage/csi-resizer:v1.13.1],SizeBytes:32400950,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:a399393ff5bd156277c56bae0c08389b1a1b95b7fd6ea44a316ce55e0dd559d7 registry.k8s.io/sig-storage/csi-attacher:v4.8.0],SizeBytes:32231444,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:672e45d6a55678abc1d102de665b5cbd63848e75dc7896f238c8eaaf3c7d322f registry.k8s.io/sig-storage/csi-provisioner:v5.1.0],SizeBytes:32167411,},ContainerImage{Names:[litmuschaos.docker.scarf.sh/litmuschaos/chaos-operator@sha256:f37e85afc0412a47d1e028e5f86b6cc3a8cbbfe59369beba0af5401aa47dfd63 litmuschaos.docker.scarf.sh/litmuschaos/chaos-operator:3.6.0],SizeBytes:29032757,},ContainerImage{Names:[litmuschaos.docker.scarf.sh/litmuschaos/chaos-runner@sha256:a762f650ce60ab0698c79e4b646c941933fab46837c69a0a888addb6bda0ccb6 litmuschaos.docker.scarf.sh/litmuschaos/chaos-runner:3.6.0],SizeBytes:27151116,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v20250214-acbabc1a],SizeBytes:22540870,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.12.0],SizeBytes:20939036,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:65192845eeac8e24a708f865911776a0d8490ab886e78dad17e80ae1870e7410 registry.k8s.io/sig-storage/hostpathplugin:v1.16.1],SizeBytes:20349620,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper-crds@sha256:011fadc314224fa0dccb59b3770ae3f355c31ae512bbcbb3ca4a362c7d616622 docker.io/openpolicyagent/gatekeeper-crds:v3.20.1],SizeBytes:18120390,},ContainerImage{Names:[docker.io/openpolicyagent/gatekeeper-crds@sha256:d60ccbbfb53422fd0af71486ed5171343f741e9e7ef9fa4dea86719e684d5e54 docker.io/openpolicyagent/gatekeeper-crds:v3.20.0],SizeBytes:17993290,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[quay.io/coreos/etcd@sha256:f6602cc2b5a2ff2138db48546d727e72599cd14021cdc5309142f407f5d43969 quay.io/coreos/etcd:v3.2.32],SizeBytes:16250306,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:d7138bcc3aa5f267403d45ad4292c95397e421ea17a0035888850f424c7de25d registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.13.0],SizeBytes:14781503,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:2c8d61c46f484d881db43b34d13ca47a269336e576c81cf007ca740fa9ec0800 docker.io/coredns/coredns:1.6.7],SizeBytes:13598515,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:cc8fb77bc2a0541949d1d9320a641b82fd392b0d3d8145469ca4709ae769980e docker.io/coredns/coredns:1.8.0],SizeBytes:12945155,},ContainerImage{Names:[docker.io/coredns/coredns@sha256:4a6e0769130686518325b21b0c1d0688b54e7c79244d48e1b15634e98e40c6ef docker.io/coredns/coredns:1.7.1],SizeBytes:12935701,},ContainerImage{Names:[docker.io/curlimages/curl@sha256:3dfa70a646c5d03ddf0e7c0ff518a5661e95b8bcbc82079f0fb7453a96eaae35 docker.io/curlimages/curl:8.12.0],SizeBytes:10048754,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[gcr.io/google-samples/hello-go-gke@sha256:4ea9cd3d35f81fc91bdebca3fae50c180a1048be0613ad0f811595365040396e gcr.io/google-samples/hello-go-gke:1.0],SizeBytes:4381769,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-expansion-2755^4 kubernetes.io/csi/csi-mock-csi-mock-volumes-expansion-7967^e0c29be3-9754-11f0-9271-12d89ef636e1],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-expansion-7967^e0c29be3-9754-11f0-9271-12d89ef636e1,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-expansion-2755^4,DevicePath:,},},Config:nil,RuntimeHandlers:[]NodeRuntimeHandler{NodeRuntimeHandler{Name:test-handler,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},NodeRuntimeHandler{Name:runc,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},NodeRuntimeHandler{Name:,Features:&NodeRuntimeHandlerFeatures{RecursiveReadOnlyMounts:*true,UserNamespaces:*true,},},},Features:&NodeFeatures{SupplementalGroupsPolicy:*true,},},} I0922 01:39:13.875943 25 dump.go:116] Logging kubelet events for node latest-worker2 I0922 01:39:13.880422 25 dump.go:121] Logging pods the kubelet thinks are on node latest-worker2 I0922 01:39:13.897758 25 dump.go:128] kube-system/kindnet-pthkx started at 2025-08-14 10:01:24 +0000 UTC (0+1 container statuses recorded) I0922 01:39:13.897792 25 dump.go:134] Container kindnet-cni ready: true, restart count 0 I0922 01:39:13.897819 25 dump.go:128] csi-mock-volumes-expansion-2755-154/csi-mockplugin-resizer-0 started at 2025-09-22 01:38:58 +0000 UTC (0+1 container statuses recorded) I0922 01:39:13.897841 25 dump.go:134] Container csi-resizer ready: true, restart count 0 I0922 01:39:13.897861 25 dump.go:128] csi-mock-volumes-expansion-2755-154/csi-mockplugin-attacher-0 started at 2025-09-22 01:38:58 +0000 UTC (0+1 container statuses recorded) I0922 01:39:13.897881 25 dump.go:134] Container csi-attacher ready: true, restart count 0 I0922 01:39:13.897900 25 dump.go:128] csi-mock-volumes-expansion-7967-1281/csi-mockplugin-0 started at 2025-09-22 01:38:40 +0000 UTC (0+3 container statuses recorded) I0922 01:39:13.897919 25 dump.go:134] Container csi-provisioner ready: true, restart count 0 I0922 01:39:13.897938 25 dump.go:134] Container driver-registrar ready: true, restart count 0 I0922 01:39:13.897957 25 dump.go:134] Container mock ready: true, restart count 0 I0922 01:39:13.897977 25 dump.go:128] csi-mock-volumes-expansion-8098-2538/csi-mockplugin-0 started at 2025-09-22 01:38:23 +0000 UTC (0+4 container statuses recorded) I0922 01:39:13.897996 25 dump.go:134] Container busybox ready: true, restart count 0 I0922 01:39:13.898015 25 dump.go:134] Container csi-provisioner ready: true, restart count 1 I0922 01:39:13.898032 25 dump.go:134] Container driver-registrar ready: true, restart count 0 I0922 01:39:13.898051 25 dump.go:134] Container mock ready: true, restart count 0 I0922 01:39:13.898072 25 dump.go:128] csi-mock-volumes-expansion-2755/pvc-volume-tester-c9lrs started at 2025-09-22 01:39:05 +0000 UTC (0+1 container statuses recorded) I0922 01:39:13.898090 25 dump.go:134] Container volume-tester ready: true, restart count 0 I0922 01:39:13.898111 25 dump.go:128] kube-system/kube-proxy-splj6 started at 2025-08-14 10:01:24 +0000 UTC (0+1 container statuses recorded) I0922 01:39:13.898130 25 dump.go:134] Container kube-proxy ready: true, restart count 0 I0922 01:39:13.898156 25 dump.go:128] csi-mock-volumes-expansion-7967-1281/csi-mockplugin-resizer-0 started at 2025-09-22 01:38:40 +0000 UTC (0+1 container statuses recorded) I0922 01:39:13.898174 25 dump.go:134] Container csi-resizer ready: true, restart count 0 I0922 01:39:13.898196 25 dump.go:128] csi-mock-volumes-expansion-7967/pvc-volume-tester-pzgc7 started at 2025-09-22 01:38:47 +0000 UTC (0+1 container statuses recorded) I0922 01:39:13.898214 25 dump.go:134] Container volume-tester ready: true, restart count 0 I0922 01:39:13.898233 25 dump.go:128] csi-mock-volumes-expansion-2755-154/csi-mockplugin-0 started at 2025-09-22 01:38:58 +0000 UTC (0+4 container statuses recorded) I0922 01:39:13.898252 25 dump.go:134] Container busybox ready: true, restart count 0 I0922 01:39:13.898268 25 dump.go:134] Container csi-provisioner ready: true, restart count 0 I0922 01:39:13.898286 25 dump.go:134] Container driver-registrar ready: true, restart count 0 I0922 01:39:13.898305 25 dump.go:134] Container mock ready: true, restart count 0 I0922 01:39:13.898325 25 dump.go:128] kube-system/create-loop-devs-pw6dk started at 2025-08-14 10:01:25 +0000 UTC (0+1 container statuses recorded) I0922 01:39:13.898343 25 dump.go:134] Container loopdev ready: true, restart count 0 I0922 01:39:13.898365 25 dump.go:128] csi-mock-volumes-expansion-7967-1281/csi-mockplugin-attacher-0 started at 2025-09-22 01:38:40 +0000 UTC (0+1 container statuses recorded) I0922 01:39:13.898384 25 dump.go:134] Container csi-attacher ready: true, restart count 0 I0922 01:39:14.574466 25 kubelet_metrics.go:206] Latency metrics for node latest-worker2 STEP: Destroying namespace "mutable-allocatable-mock-2145" for this suite. @ 09/22/25 01:39:14.575 << Timeline [FAILED] CSINode allocatable count was not updated to 8 in time: context deadline exceeded In [It] at: k8s.io/kubernetes/test/e2e/storage/csimock/mutable_csinode_allocatable.go:122 @ 09/22/25 01:38:26.244 ------------------------------ SSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSS•SSSSSSSSSSSSSS•SSS•SSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSS•SS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSS•S•SSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSS•S•S•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSS•SSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSS•SSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSS•SSSSSSS••SSSSSSSSSSSS•SSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSS•SSSSSSSSSSSSSSS•••••••••SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS•SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS Summarizing 2 Failures: [FAIL] [sig-storage] MutableCSINodeAllocatableCount [FeatureGate:MutableCSINodeAllocatableCount] [Beta] [Feature:OffByDefault] Dynamic Allocatable Count [It] should observe dynamic changes in CSINode allocatable count [sig-storage, FeatureGate:MutableCSINodeAllocatableCount, Beta, Feature:OffByDefault, BetaOffByDefault] k8s.io/kubernetes/test/e2e/storage/csimock/mutable_csinode_allocatable.go:122 [FAIL] [sig-storage] MutableCSINodeAllocatableCount [FeatureGate:MutableCSINodeAllocatableCount] [Beta] [Feature:OffByDefault] Attach Limit Exceeded [It] should transition pod to failed state when attachment limit exceeded [sig-storage, FeatureGate:MutableCSINodeAllocatableCount, Beta, Feature:OffByDefault, BetaOffByDefault] k8s.io/kubernetes/test/e2e/storage/csimock/mutable_csinode_allocatable.go:215 Ran 200 of 7132 Specs in 1072.503 seconds FAIL! -- 198 Passed | 2 Failed | 0 Pending | 6932 Skipped Ginkgo ran 1 suite in 17m54.801402924s Test Suite Failed