Shards

One index becomes several. Each shard is a complete search index over part of the data.

The question

What happens when the data outgrows one machine?

The structure responsible

Partitioned index

In this lab: Change the shard count and watch fan-out, distribution and per-shard statistics move.

building the index…