Teaching Neural Networks a Common Language: Overcoming the Vocabulary Gap
52.4 nDCG@10—that's the result ModernBERT achieves after Vocabulary Transfer. Just yesterday it stumbled over letter case, and today it outranks the best sparse retrievers.
A neural network flunks search because it can't agree on words. 'Token' and 'token' are two distinct universes to it.