Tokenization, Normalization & Stemming

Character filters, a tokenizer, then token filters. A token is intermediate; a term is what gets indexed.

In this lab: Build an analyzer stage by stage and see index-time and query-time analysis agree — or silently disagree.