DEV SAGA

Phase 5-4 · Chapter XXV · World 5, Intelligence Range · Kata

Small language models

What to study in Small language models, in this order: 3 books from first step to reference, 1 AI skill to use at work and the people worth following.

Reading path, in order

  1. 1. Start hereHands-On Large Language ModelsJay Alammar, Maarten GrootendorstSee on Amazon
  2. 2. Go deeperNatural Language Processing with TransformersLewis Tunstall, Leandro von Werra, Thomas WolfSee on Amazon
  3. 3. ReferenceBuild a Large Language Model (From Scratch)Sebastian RaschkaSee on Amazon

AI skills for everyday work

/right-sized-model

Using the largest model for every task.

  • Assesses whether the task fits a small model
  • Estimates the cost, latency and privacy of each option
  • Compares fine-tuning with prompting
  • Defines the comparison test between the models

How to ask: Use the skill right-sized-model on support ticket classification.

Who to follow

Play this phase on the map

Dev Saga is a pixel-art world map with the 30 phases of the journey to Staff Engineer. Track what you read and used, on your own or with a book club, and export your progress to show your leadership.

Open phase 5-4 on the map Bring it to my team