All 30 phases › Small language models
Phase 5-4 · Chapter XXV · World 5, Intelligence Range · Kata
Small language models
What to study in Small language models, in this order: 3 books from first step to reference, 1 AI skill to use at work and the people worth following.
Reading path, in order
1. Start here Hands-On Large Language Models Jay Alammar, Maarten Grootendorst See on Amazon
2. Go deeper Natural Language Processing with Transformers Lewis Tunstall, Leandro von Werra, Thomas Wolf See on Amazon
3. Reference Build a Large Language Model (From Scratch) Sebastian Raschka See on Amazon
AI skills for everyday work
/right-sized-model Using the largest model for every task.
Assesses whether the task fits a small model Estimates the cost, latency and privacy of each option Compares fine-tuning with prompting Defines the comparison test between the models How to ask: Use the skill right-sized-model on support ticket classification.
Play this phase on the map
Dev Saga is a pixel-art world map with the 30 phases of the journey to Staff Engineer. Track what you read and used, on your own or with a book club, and export your progress to show your leadership.
Open phase 5-4 on the map Bring it to my team
← 5-3 · Machine learning
5-5 · AI engineering →