When Neural Networks See the World the Same Way express

Original: "Modulating Cross-Modal Convergence with Single-Stimulus, Intra-Modal Dispersion"
arXiv:2604.21836 · 2026-04-23 · CC BY 4.0 · 1 min
Some images make different neural networks think alike, and this aligns with how language describes them.

Show the same photo of a cat to two different neural networks, and they often reach a similar conclusion: "cat." But ask them for more detail, and their answers may diverge. One model focuses on the whiskers, another on the coat color, a third on the pose. So even within the "visual" world of neural networks, there's no complete unity.

Researchers devised a way to measure this unity for each image individually. They took several visual neural networks with different training tasks and compared their internal representations. For some images, the models are nearly unanimous; for others, they diverge significantly. Then they showed these images to language models that describe images in words. It turned out: when visual models agree with each other, their collective opinion aligns better with the language description. The difference can be twofold.

A jury of five experts looks at a painting. If all five give similar descriptions, then the museum label under the painting is likely to be close to their opinion. If the experts disagree, the label will be less accurate.

This result suggests that agreement among neural networks is not a coincidence. It reflects how "understandable" the image turned out to be. The clearer its structure, the easier it is for both vision and language to find common ground. This approach helps reveal where neural networks converge with human perception and where they diverge.

Agreement among visual neural networks for the same image can vary by a factor of two, as if one photo is "more understandable" than another for artificial intelligence.

Concepts
stimulus self-supervised learning neural networks in spatial mapping predictive learning neural networks Large Language Models confusion matrix autism generalization training k means clustering xgboost Baldwin effect parameter speech recognition training data prognosis regularization methods medical imaging ai symbolic regression modulation