Overlapping Features Speed Up Learning
A neural network can be compared to a dormitory where each resident gets their own room. Usually, each feature in the data occupies a separate neuron, and learning proceeds sequentially: first one feature, then another. This is slow and depends on which data you happen to get.
But if you allow several features to share a room, overlap them, the picture changes.