Fine-tune a Llama model with Unsloth + LoRA without Googling
Когда использовать: You have a dataset and want Claude to produce a runnable training script with correct flags.
Предварительные требования
- Unsloth installed — pip install unsloth — the skill will remind you of the nightly build caveats
Поток
-
Describe the target runUse the unsloth skill. Fine-tune Llama-3-8B on my dataset at ~/data/train.jsonl, QLoRA, 3 epochs, output to ./out.✓ Скопировано→ Claude writes a script with correct Unsloth imports and real CLI flags
-
Ask for the config explanationWalk me through each hyperparameter and why.✓ Скопировано→ Reasoning grounded in Unsloth's docs, not generic ML clichés
Итог: A training script that runs on the first try.
Подводные камни
- Claude mixes HF Trainer and Unsloth idioms — Insist on 'use the unsloth skill only' — don't pull from Transformers skill