You'll notice
Useful2 Signal0
Search now joins stray single-character tokens with their neighbours, so split-up terms match better.
What's wrong with this entry?
Anonymous. No account, no email.
What
Query tokenization pairs a single-character token with an adjacent multi-character neighbour and offers the joined form as an extra candidate, improving matches on terms that were split apart.
Details
- The joined form is appended before the compound-first ordering is applied.
- Compound candidates are still filtered out unless the caller explicitly asked for compounds.
Evidence
compound
Strings lifted out of the shipped bundle, so the claim above can be checked against them.