Compression & Checksums

Gaps instead of ids, vints instead of fixed widths, blocks instead of whole lists. Checksums catch corruption.

The question

How small can this get, and how do we know it is intact?

The structure responsible

Gap encoding, bit packing, CRC32

In this lab: Compress real postings four ways, then flip a byte and watch the checksum catch it.

building the index…