Author a new skill and iterate it to 'actually works'
Quand l'utiliser : You have an idea for a skill but every time you write one, it degrades after 3 uses.
Déroulement
-
ScaffoldUse woodshed. Create a new skill called 'changelog-writer' that turns git logs into user-facing changelogs.✓ Copié→ skills/changelog-writer/ created with SKILL.md
-
Create test casesGenerate 5 diverse test inputs.✓ Copié→ tests/ folder with 5 sample git log fixtures
-
Run and rateRun the skill on each. Show me the output; I'll rate.✓ Copié→ Outputs presented with rating slots
-
Iterate based on ratingsBased on my ratings, suggest prompt changes to SKILL.md. Don't apply yet.✓ Copié→ Proposed diff with rationale per change
Résultat : A skill that works on your real use cases, not just the demo.
Pièges
- Overfitting to test cases — Hold out some tests; re-run after every iteration to catch regressions
Combiner avec : filesystem