DEV SAGA

Phase 5-1 · Chapter XXII · World 5, Intelligence Range · Kata

Data engineering

What to study in Data engineering, in this order: 3 books from first step to reference, 1 AI skill to use at work and the people worth following.

Reading path, in order

  1. 1. Start hereFundamentals of Data EngineeringJoe Reis, Matt HousleySee on Amazon
  2. 2. Go deeperThe Data Warehouse ToolkitRalph Kimball, Margy RossSee on Amazon
  3. 3. ReferenceDesigning Data-Intensive ApplicationsMartin KleppmannSee on Amazon

AI skills for everyday work

/data-contract

Pipelines that break when someone changes a column.

  • Defines the schema and the contract between producers and consumers
  • Points out columns with no owner or no clear meaning
  • Checks quality: nulls, duplicates, delays
  • Draws the data lineage

How to ask: Use the skill data-contract on the orders table in the data lake.

Who to follow

Play this phase on the map

Dev Saga is a pixel-art world map with the 30 phases of the journey to Staff Engineer. Track what you read and used, on your own or with a book club, and export your progress to show your leadership.

Open phase 5-1 on the map Bring it to my team