Static Lustre volume demo

Mon, 01 Jan 0001 00:00:00 +0000

Use these snippets as starting points for demos, CI smoke tests, or reproduction cases when you report issues.

Static Lustre volume demo

Creates a static PV/PVC pointing at 10.0.0.1@tcp0:/lustre-fs and mounts it in a BusyBox deployment.

apiVersion: v1
kind: PersistentVolume
metadata:
 name: lustre-static-pv
spec:
 capacity:
 storage: 10Gi
 accessModes:
 - ReadWriteMany
 storageClassName: klustre-csi-static
 persistentVolumeReclaimPolicy: Retain
 csi:
 driver: lustre.csi.klustrefs.io
 volumeHandle: lustre-static-pv
 volumeAttributes:
 source: 10.0.0.1@tcp0:/lustre-fs
 mountOptions: flock,user_xattr
---
apiVersion: v1
kind: PersistentVolumeClaim
metadata:
 name: lustre-static-pvc
spec:
 accessModes:
 - ReadWriteMany
 storageClassName: klustre-csi-static
 resources:
 requests:
 storage: 10Gi
 volumeName: lustre-static-pv
---
apiVersion: apps/v1
kind: Deployment
metadata:
 name: lustre-demo
spec:
 replicas: 1
 selector:
 matchLabels:
 app: lustre-demo
 template:
 metadata:
 labels:
 app: lustre-demo
 spec:
 containers:
 - name: app
 image: busybox
 command: ["sleep", "infinity"]
 volumeMounts:
 - name: lustre-share
 mountPath: /mnt/lustre
 volumes:
 - name: lustre-share
 persistentVolumeClaim:
 claimName: lustre-static-pvc

Validate

kubectl apply -f lustre-demo.yaml
kubectl exec deploy/lustre-demo -- df -h /mnt/lustre
kubectl exec deploy/lustre-demo -- sh -c 'echo "hello $(date)" > /mnt/lustre/hello.txt'

Delete when finished:

Share a dataset between prep and training jobs

Mon, 01 Jan 0001 00:00:00 +0000

This tutorial wires a simple data pipeline together:

Create a static Lustre PersistentVolume and bind it to a PersistentVolumeClaim.
Run a data-prep job that writes artifacts into the Lustre mount.
Start a training deployment that reads the prepared data.
Validate shared access and clean up.

Requirements

Klustre CSI Plugin installed and verified (see the Introduction).
An existing Lustre export, e.g., 10.0.0.1@tcp0:/lustre-fs.
kubectl access with cluster-admin privileges.

1. Define the storage objects

Save the following manifest as lustre-pipeline.yaml. Update volumeAttributes.source to match your Lustre target and tweak mountOptions if required.

Tutorials on KlustreFS

Static Lustre volume demo

Static Lustre volume demo

Validate

Share a dataset between prep and training jobs

Requirements

1. Define the storage objects