Fine-tune a Llama model with Unsloth + LoRA without Googling
Wann einsetzen: You have a dataset and want Claude to produce a runnable training script with correct flags.
Voraussetzungen
- Unsloth installed — pip install unsloth — the skill will remind you of the nightly build caveats
Ablauf
-
Describe the target runUse the unsloth skill. Fine-tune Llama-3-8B on my dataset at ~/data/train.jsonl, QLoRA, 3 epochs, output to ./out.✓ Kopiert→ Claude writes a script with correct Unsloth imports and real CLI flags
-
Ask for the config explanationWalk me through each hyperparameter and why.✓ Kopiert→ Reasoning grounded in Unsloth's docs, not generic ML clichés
Ergebnis: A training script that runs on the first try.
Fallstricke
- Claude mixes HF Trainer and Unsloth idioms — Insist on 'use the unsloth skill only' — don't pull from Transformers skill