Manual Test Cases

Functional test cases

Deployment of Longhorn
UI
Volume
Kubernetes
Backup
Node
Scheduling
Upgrade
Monitoring

Pre-release tests

Backup & Restore tests

#1279 DR volume live upgrade and rebuild
#1341 concurrent backup test
#1404 test backup functionality on google cloud and other s3 interop providers.
#4637 pull backup created by another Longhorn system
Sync up with backup target during DR volume activation

Basic operations

Snapshot while writing data in the volume
Storage Network Test

Cluster Restore

Restore to a new cluster
Restore to an old cluster

Environment

Cluster using customize kubelet root directory
Compatibility with k3s and SELinux
Test Longhorn deployment on RKE2 v1.24- with CIS-1.6 profile
Test Longhorn deployment on RKE2 v1.25+ with CIS-1.23 profile

HA

Backing Image Error Reporting and Retry
Disk migration in AWS ASG
HA Volume Migration
Replica Rebuilding

Managed Kubernetes Clusters (EKS, GKE, AKS)

AKS

Expand Volume
Upgrade K8s

EKS

Add Extra Volume
Expand Volume
Upgrade K8s

GKE

Expand Volume
Upgrade K8s

Node

Degraded availability with added nodes
Improve Node Failure Handling By Automatically Force Delete Terminating Pods of StatefulSet/Deployment On Downed Node

Node Not Ready

Kubulete Restart

Test kubelet restart on a node of the cluster

Node Disconnection

Node disconnection test

Node Down

#1355 The node the restore volume attached to is down
Backing Image on a down node
Node drain and deletion test
Physical node down
Single replica node down
Test node deletion

Node Restart

#1366 && #1328 The node the DR volume attached to is rebooted
Physical node reboot

Resiliency

#2206 Fix the spinning disk on Longhorn
PVC provisioning with insufficient storage
Test Longhorn components recovery
Test timeout on loss of network connectivity

Stability

Checksum enabled large volume with multiple rebuilding
Longhorn installation multiple times

Test backup listing S3/NFS
UI

ui sanity check

Uninstallation Checks
Upgrade

Automatically Upgrading Longhorn Engine Test
Kubernetes upgrade test
Longhorn Upgrade test
Re-deploy CSI components when their images change
Test Backing Image during Longhorn upgrade
Test Engine Crash During Live Upgrade
Test Node Drain Policy Setting
Test system upgrade with a new storage class being default
Test System Upgrade with New Instance Manager
Upgrade Conflict Handling test

v2 volume

v2 volume sanity check

Rancher integration test cases

Access Longhorn GUI using Rancher proxy
Drain using Rancher UI
Longhorn in an hardened cluster
Longhorn using fleet on multiple downstream clusters
Upgrade Kubernetes using Rancher UI
Upgrade Kubernetes using SUC

Release specific tests

v1.0.0

New Node with Custom Data Directory
Operating System specific tests for SUSE SLES12SP3

Testing ext4 with custom fs params1 (no 64bit, no metadata_csum)
Testing ext4 with custom fs params2 (no metadata_csum)
Testing ext4 without custom fs params
Testing xfs after custom fs params (xfs should ignore the custom fs params)

v1.0.1

BestEffort Recurring Job Cleanup
Change imagePullPolicy to IfNotPresent Test
DR volume related latest backup deletion test
NFSv4 Enforcement (No NFSv3 Fallback)
Priority Class Default Setting
Return an error when fail to remount a volume
Test access style for S3 compatible backupstore
Test S3 backupstore in a cluster sitting behind a HTTP proxy
Volume Deletion UI Warnings

v1.0.2

Upgrade Lease Lock

v1.1.0

Prometheus Support
Recurring backup job interruptions
Reusing failed replica for rebuilding
Support Kubelet Volume Metrics
Test Additional Printer Columns
Test Instance Manager IP Sync
Test ISCSI Installation on EKS
Test Read Write Many Feature
Test uninstallation
Upgrade Longhorn with modified Storage Class

v1.1.1

CSI Sanity Check
Longhorn with engine is not deployed on all the nodes
Set Tolerations/PriorityClass For System Components
Test Disable IPv6
Test File Sync Cancellation
Test Frontend Traffic
Test Node Delete
Test Node Selector
Test RWX share-mount ownership reset
Test Service Account mount on host
Test Snapshot Purge Error Handling
Test system upgrade with the deprecated CPU setting

v1.1.2

Test CronJob For Volumes That Are Detached For A Long Time
Test Frontend Web-socket Data Transfer When Resource Not Updated
Test Instance Manager Streaming Connection Recovery

v1.2.0

Test backing image
Test Backup Creation With Old Engine Image
Test instance manager cleanup during uninstall
Test Label-driven Recurring Job
Test Version Bump of Kubernetes, API version group, CSI component’s dependency version

v1.2.3

Test backing image checksum mismatching
Test backing image space usage with sparse files
Test scalability with backing image

v1.3.0

Extended CSI snapshot support to Longhorn snapshot
Setup and test storage network
Test backing image download to local
Test Helm uninstall Longhorn in different namespace
Test IM Proxy connection metrics
Test instance manager NPE
Test longhorn manager NPE caused by backup creation
Test longhorn manager pod starting scalability
Test NPE when longhorn UI deployment CR not exist
Test snapshot purge retry

v1.3.1

Test transient error in engine status during eviction

v1.4.0

Test CSI plugin liveness probe
Test engine binary recovery
Test filesystem trim
Test helm on Rancher deployed Windows Cluster
Test Longhorn system backup should sync from the remote backup target
Test Node ID Change During Backing Image Creation
Test Online Expansion
Test replica scale-down warning
Test upgrade for migrated Longhorn on Rancher

v1.4.1

Test the trim related option update for old volumes

v1.5.0

Test upgrade responder collecting extra info
Test Volume Replica Zone Soft Anti-Affinity Setting

v1.6.0

Setup and test storage network when Multus version is above v4.0.0
Test Rebuild in volume.meta blocks engine start
Test engine version enforcement
Test list backup when cluster has node cordoned before Longhorn installation
Test PVC Name and Namespace included in the volume metrics
Test Replica Disk Soft Anti-Affinity
Test Support Bundle Metadata File
Test Support Bundle Should Include Kubelet Log When On K3s Cluster
Test Support Bundle Syslog Paths
Test upgrade responder should collect SPDK related info

v1.7.0

Dependency setup for GKE cluster using Container-Optimized OS as base image
restarting Kubelet should not result in repeated “no Pending workload pods …” event for the workload pod.

Test cases to reproduce issues related to attach detach

Test cases to reproduce attachment-detachment issues

Physical node reboot

Reboot the node that the controller (StatefulSet/Deployment) attached to. After reboot complete, the volume should be reattached to the node.

[Edit]